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CONSOLIDATED STATE APPLICATION ACCOUNTABILITY WORKBOOK 



New Hampshire is in the midst of a transition - a transition between assessment systems - a transition 
between accountability systems. The elementary grades were assessed with the newly developed New 
England Common Assessment Program (NECAP) tests in October 2005. The high school (grade 10) will 
be assessed with New Hampshire’s previous state-wide assessment - NHEIAP one last time (May 2006). 
Consistent with the previously approved transition plan for 3-8, NH tenth graders next year will be 
assessed in the fall of 1 1 th grade. The accountability system will undergo a corresponding transition. New 
Hampshire proposes to transition accountability for elementary and middle schools to a system that 
introduces an index system and addresses the complexities of fall testing. Details of the new 
accountability system are included in the first paid of the submission (pages 3-40). Since the high school 
assessment will make a si mi lar transition beginning the fall of 2007, New Hampshire plans to keep the 
accountability system at the high school level the same as the previously approved system from last year. 
Details of our previous system are included in the second paid of this submission (pages 41-77) ) Please 
be aware that no changes what-so-ever were made to the previously approved workbook, and arc included 
only for your reference. 

To orient you to the changes New Hampshire proposes for grade school and middle school accountability, 
we would like to point out two very important issues/changes. First, New Hampshire proposes to move to 
an index system. Schools will be given full credit (100 points) for each student scoring proficient or 
better, and partial credit for students who score below proficient based on a sliding scale. The index for a 
school or district is the average of the student points. The 2013-2014 goal for every school, district, and 
the state is 100. The only way to reach this goal is to have all students scoring proficient or better at that 
time. This system acknowledges the hard work teachers put into addressing the needs of the students 
scoring below proficient and awards points to the school for positive movement toward proficiency. 
Second, New Hampshire has worked very hard to create a system that holds schools and districts 
accountable for the portion of the system which they control. Specifically, with a fall test, participation 
rates and performance indices are based on potentially somewhat different sets of students. Clearly, a 
school is responsible for testing all the students enrolled within its system during testing. Not so clear, 
perhaps, a school may not be responsible for the performance all the students it tested. For example, a 
junior high school may contain grades 7 and 8. Clearly the school must test all its students enrolled at the 
time of testing. Yet, the school did not teach any of the students last year who arc now in its 7 th grade. 
Remember, with a fall test, we are evaluating the effectiveness of the previous grade’s program in 
preparing students for the following grade. New Hampshire proposes to utilize its newly implemented 
state-assigned student ID system and student data management system to assign responsibility for the 
performance of each student to the school where the student was enrolled last year. Hence, the scores 
generated by the 7 th grade students will be included in the school AYP report for the school each student 
attended last year in grade 6. 

Finally, on a personal note, please be aware that New Hampshire has been without an administrator for 
the Office of Accountability for 7 months. We have hired a new person who will join the Department in 
mid April. I include this only to indicate that I have no experience with submitting this workbook in the 
past. If there arc areas of omission or areas that are less than crystal clear, I apologize. We arc ready to 
respond to any questions, requests for clarification, or areas that may need to be revisited. I would like to 
thank the staff at the US Education Department for their continued support, guidance, and 
encouragement. The issues that face us today arc complicated and sometimes overwhelming. Working 
together can only help us support teachers, students, and their families. 

- Tim Kurtz, Director of Assessment, Office of Curriculum and Assessment 

This revision includes the return to a cell size of 1 1 for performance (as previously approved) and 
refigured stalling points and intermediate goals for English/Eanguage Arts and Mathematics, all found in 
section 3.2. 
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Revised by Deb Wiswell, Administrator for the Bureau of Accountability, July 21, 2006 
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New Hampshire’s 
Proposed 

Accountability System 
Grades 1-8 

(will be applied to elementary and middle schools) 




CONSOLIDATED STATE APPLICATION ACCOUNTABILITY WORKBOOK 



PRINCIPLE 1. A single statewide Accountability System applied to all public 
schools and LEAs. 



CRITICAL 

ELEMENT 


EXAMPLES FOR 

MEETING STATUTORY REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


1.1 How does the 


Every public school and LEA is required to make adequate 


A public school or 


State 


yearly progress and is included in the State Accountability 


LEA is not required to 


Accountability 


System. 


make adequate 


System 
include every 


State has a definition of “public school” and “LEA” for AYP 


yearly progress and is 
not included in the 


public school 


accountability purposes. 


State Accountability 


and LEA in 


• The State Accountability System produces AYP 


System. 


the State? 


decisions for all public schools, including public 
schools with variant grade configurations (e.g., K-12), 
public schools that serve special populations (e.g., 
alternative public schools, juvenile institutions, state 
public schools for the blind) and public charter 
schools. It also holds accountable public schools with 
no grades assessed (e.g., K-2). 


State policy 
systematically 
excludes certain 
public schools and/or 
LEAs. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 
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New Hampshire will produce AYP reports for all public schools (including public schools, charter schools, 
public academies), and their corresponding public districts. Students in these public educational 
agencies will be called public school students. 

In 1993, the New Hampshire Legislature enacted state law RSA 193-C. “There is established within the 
department of education a statewide education improvement and assessment program (New Hampshire 
Educational Improvement and Assessment Program - NHEIAP). The State requires that all public school 
students enrolled in grades 3-8 participate in the state-wide assessment for their grade of enrollment. 

New Hampshire will hold all public schools accountable for adequate yearly progress. New Hampshire 
has surveyed its public schools to make sure that all public alternative programs are connected to the 
existing public school structure. There are no public alternative schools within the state. 

Several New Hampshire schools have no grade level tested within the grade spans included in the 
school. Currently, these schools fall into two categories: schools with grades 1 -2 and schools with just 
grade 1 . In the first case, schools will be held accountable for the performance of the third grade students 
in the state that were second graders in their school last year. In the second case, schools with only first 
grade will be evaluated with an on-site visit. There are 3 such schools in NH. 

In addition, New Hampshire has many small schools. Several schools are small enough so that their 
grade level aggregate assessment data is confidential. Once AYP reports have been run, schools with 
fewer than the minimum number of students needed to run performance calculations will be evaluated 
with an on-site visit. The evaluation will be based primarily on student performance data including 
performance on the statewide assessment. Confidential student and school level data will remain 
confidential. The AYP status would become public, as would a written rationale for the decision. 

Not all public school students attend public schools in the state. A student is identified as a public school 
student when public funds are used to pay for his or her education. These students fall into three 
categories. 

1 . Public school students who attend public schools out of state: these students are 
included in the assessment and accountability system of the state in which they are 
schooled. State law RSA 193-C:6 details the participation of students involved in 
interstate agreements. 

2. Public school students who attend private in-state schools (usually these students are 
special education students and/or court ordered placements): these students are 
assessed and included in state level aggregate and disaggregate data. There is no 
provision under state or federal law to include private schools in the accountability 
system. Furthermore, these students do not fall within the “enrolled for a full academic 
year” clause for either the sending public school district or appropriate school. 

3. Public school students who attend private out-of-state schools (also usually special 
education students and/or court ordered placements): these students participate in the 
assessment and accountability system for either New Hampshire or the receiving state. 
(Guidelines are established in Procedures for Determining How Each Student Will 
Participate in the New Hampshire Educational Improvement and Assessment Program 
(NHEIAP) available at www.ed.state.nh.us/Assessment/materials.htm) 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING STATUTORY 
REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


1.2 How are all public schools 
and LEAs held to the same 
criteria when making an AYP 
determination? 


All public schools and LEAs are 
systematically judged on the 
basis of the same criteria when 
making an AYP determination. 

If applicable, the AYP definition is 
integrated into the State 
Accountability System. 


Some public schools and LEAs 
are systematically judged on the 
basis of alternate criteria when 
making an AYP determination. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 


All public elementary and middle schools and their LEAs will be judged on a single AYP definition. AYP 
will be based on student performance on the statewide assessment, 95% participation rate, and 
attendance rate at the elementary/middle school level. 
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CRITICAL ELEMENT 


EXAMPLES FOR 

MEETING STATUTORY REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


1 .3 Does the State have, 


State has defined three levels of student 


Standards do not meet 


at a minimum, a 


achievement: basic, proficient and advanced - 1 


the legislated 


definition of basic, 
proficient and 
advanced student 
achievement levels in 
reading/language 
arts and 
mathematics? 


Student achievement levels of proficient and 
advanced determine how well students are 
mastering the materials in the State’s academic 
content standards; and the basic level of 
achievement provides complete information about 
the progress of lower-achieving students toward 
mastering the proficient and advanced levels. 


requirements. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



The New Hampshire accountability system is based on the New England Common Assessment Program 
(NECAP). The NECAP has four clearly defined achievement levels: Substantially Below Proficient (level 
1), Partially Proficient (level 2), Proficient (level 3), and Proficient with Distinction (level 4). 

New Hampshire reports assessment data in two forms: achievement level (indicated above), and scaled 
score (X00-X80, where X indicates the grade level of the test). The two statistics are connected as 
follows: Proficient includes scores greater than or equal to X40 at each grade level. Level 1 and 2 
represents unacceptable performance. 

Achievement levels for each subject area at each grade level assessed are defined in the annual 
statewide assessment reports: parent letters, and school and district reports. Parent reports include 
information on overall achievement in each content area (reading and mathematics), and more detailed 
information about achievement within defined sub-score categories in each subject. 

NH achievement levels are linked to the grade level content standards and describe how well students 
have mastered the material in reading and mathematics. 



1 System of State achievement standards will be reviewed by the Standards and Assessments Peer 
Review. The Accountability Peer Review will determine that achievement levels are used in determining 
AYP. 



8 





CONSOLIDATED STATE APPLICATION ACCOUNTABILITY WORKBOOK 



CRITICAL ELEMENT 


EXAMPLES FOR 

MEETING STATUTORY REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


1.4 How does the 
State provide 
accountability and 
adequate yearly 
progress 
decisions and 
information in a 
timely manner? 


State provides decisions about adequate yearly progress 
in time for LEAs to implement the required provisions 
before the beginning of the next academic year. 

State allows enough time to notify parents about public 
school choice or supplemental educational service options, 
time for parents to make an informed decision, and time to 
implement public school choice and supplemental 
educational services. 


Timeline does not 
provide sufficient 
time for LEAs to 
fulfill their 
responsibilities 
before the 
beginning of the 
next academic 
year. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 


It is the Department’s intent to provide accountability reports to all schools in a timely manner. With fall 
testing for grades 3-8, accountability reports will be released prior to the end of the school year. This first 
year of the NECAP program, New Hampshire has released assessment results for grades 3-8 later than it 
will in the future - March 21 . We anticipate that accountability reports will be ready in May - early enough 
to allow schools to understand results, discuss school or district improvement issues if necessary, inform 
parents about their legal options as defined by Title 1 and state rules, and take advantage of the summer 
months in addressing curriculum and school improvement issues. 
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EXAMPLES FOR 


EXAMPLES OF 


CRITICAL 


MEETING STATUTORY REQUIREMENTS 


NOT MEETING 


ELEMENT 




REQUIREMENTS 


1 .5 Does the 


The State Report Card includes all the required data 


The State Report 


State 


elements [see Appendix A for the list of required data 


Card does not include 


Accountability 


elements]. 


all the required data 


System 
produce an 


The State Report Card is available to the public at the 


elements. 


annual State 


beginning of the academic year. 


The State Report 


Report Card? 


The State Report Card is accessible in languages of major 
populations in the State, to the extent possible. 


Card is not available 
to the public. 




Assessment results and other academic indicators 
(including graduation rates) are reported by student 
subgroups 




STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 


New Hampshire currently produces, through enacted legislation (RSA 193-E:3), an annual report card for 
the State, LEAs and all public schools through the NH School District Profiles link on the NH Department 
of Education’s website: www.ed.state.nh.us. It provides easy to understand information about schools 
and communities to the public. New Hampshire law requires the Department to provide attendance and 
drop-out rates; school environmental indicators and safety data; proportion of graduating students going 
on to post-secondary education and military service; and performance on the state assessment. All data 
and information used to determine AYP will be added to the NH School District Profiles including 


disaggregated data about school performance which is currently sent to the LEAs. 


The additional data 


elements, regarding teacher information, are currently being collected so that they can also be added to 
the NH School District Profiles. The pending accountability legislation has amended the reporting 


requirements to include NCLB data elements. 




New Hampshire is working to include that additional data connected to NECAP testing in all grades 3-8. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING STATUTORY 
REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


1 .6 How does the State 
Accountability System 
include rewards and 
sanctions for public schools 
and LEAs? 2 


State uses one or more types of 
rewards and sanctions, where 
the criteria are: 

• Set by the State; 

• Based on adequate yearly 
progress decisions; and, 

• Applied uniformly across 
public schools and LEAs. 


State does not implement 
rewards or sanctions for public 
schools and LEAs based on 
adequate yearly progress. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 


Rewards and sanctions for all public schools, including Title 1 and Non-Title 1 schools, have been included 
in legislation presented to the 2003 New Hampshire Legislature: Public Education Accountability System. 
This bill includes language that authorizes the Department to set up a consistent system of rewards and 
sanctions. The bill provides for a system of annual recognition and responses to school performance as 
set forth in rules: to assist local school staff with the analysis and use of school performance data, to 
assist in the implementation of local educational improvement and assessment plans, and to provide 
grants to school districts for local school improvement. This bill does not compromise any of the rewards 
and sanctions described in NCLB for Title 1 schools, however it does limit the option of State takeover 
(RSA 194-H:5). RSA 193-H:4 outlines requirements for school improvement plans for every school 
identified as being in need of improvement. 

All Title 1 schools will be held to the requirements of section 1 1 1 6 of No Child Left Behind. 



2 The state must provide rewards and sanctions for all public schools and LEAs for making adequate 
yearly progress, except that the State is not required to hold schools and LEAs not receiving Title I funds 
to the requirements of section 1 1 1 6 of NCLB [§200.1 2(b)(40)]. 
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PRINCIPLE 2. All students are included in the State Accountability System. 



CRITICAL 

ELEMENT 


EXAMPLES FOR 

MEETING STATUTORY REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


2.1 How does the 


All students in the State are included in the State 


Public school students 


State 


Accountability System. 


exist in the State for 


Accountability 




whom the State 


System include 


The definitions of “public school” and “LEA” account 


Accountability System 


all students in 


for all students enrolled in the public school district, 


makes no provision. 


the State? 


regardless of program or type of public school. 





STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



The accountability system includes all students in the grades that are currently assessed under our 
statewide assessment system. The following is taken from page 6 of the 2005 NECAP Principal/Test 
Coordinator Manual. 

“All students enrolled in the school as of October 1, 2005 are required to participate in NECAP with the 
following exceptions: 

1. Students who completed the Alternate Assessment for the 2004-2005 school year. 

2. Students who are new to the U.S. after October 1. 2004 and are LEP and take the ACCESS 
test of English language proficiency as scheduled in their states are not required to take the 
NECAP reading and writing tests. However, these students must take the NECAP 
mathematics test. 

3. Students who have state-approved special considerations. Each state department of education 
has a process for documenting and approving circumstances that make it impossible or not 
advisable for a student to participate in state testing. 

Contact the following staff or visit the state’s department of education website for additional information. 
New Hampshire — Tim Kurtz, at 603-271-3846 
Rhode Island — Mary Ann Snider, at 401-222-8492 
Vermont — Mary -Ann Minardo, at 802-828-5410 

Students who enroll in the school after October 1, 2005 should participate, to the extent possible, in 
NECAP testing. The test coordinator should determine which sessions of NECAP, if any, have been 
completed in the student’s prior school. The remaining sessions should be administered. Be sure to 
complete the appropriate box on page 2 of the Student Answer Booklet if the student was unable to 
participate in all testing sessions.” 
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CRITICAL 

ELEMENT 


EXAMPLES FOR 
MEETING STATUTORY 
REQUIREMENTS 


EXAMPLES OF 

NOT MEETING REQUIREMENTS 


2.2 How does the 


The State has a definition of “full 


LEAs have varying definitions of “full 


State define “full 
academic year” 


academic year” for determining 
which students are to be included 


academic year.” 


for identifying 
students in AYP 


in decisions about AYP. 


The State’s definition excludes students 
who must transfer from one district to 


decisions? 


The definition of full academic year 
is consistent and applied 
statewide. 


another as they advance to the next grade. 

The definition of full academic year is not 
applied consistently. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



For the purpose of accountability reporting, a full academic year is defined for students as students who 
are continuously enrolled in the school /district since the first business day in October of the previous 
school year. (Remember, we have a fall test, and the delivery of instruction that affects performance on 
the beginning-of-year assessment happened in the previous grade.) The suspension of a student does 
not affect his or her enrollment status. Since New Hampshire now collects student demographic and 
program participation information electronically, and the first LEA submissions for End-of-Year files did 
not contain this data element, New Hampshire will use the proxy of 31 0 half-days in enrollment for school 
year 2004-2005. 

The definition of full academic year is consistently applied to all schools and districts statewide. 

This definition may be revisited if the assessment timeframe changes. 
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CRITICAL 

ELEMENT 


EXAMPLES FOR 
MEETING STATUTORY 
REQUIREMENTS 


EXAMPLES OF 

NOT MEETING REQUIREMENTS 


2.3 How does the 


State holds public schools 


State definition requires students to attend the 


State 


accountable for students who 


same public school for more than a full 


Accountability 


were enrolled at the same 


academic year to be included in public school 


System 


public school for a full academic 


accountability. 


determine which 


year. 




students have 




State definition requires students to attend 


attended the 


State holds LEAs accountable 


school in the same district for more than a full 


same public 


for students who transfer during 


academic year to be included in district 


school and/or 


the full academic year from one 


accountability. 


LEA for a full 


public school within the district 




academic year? 


to another public school within 


State holds public schools accountable for 




the district. 


students who have not attended the same 
public school for a full academic year. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



LEAs have submitted End-of-Year files that include the number of half days in attendance and 
the number of half days absent. Together, we have a count of the number of half days in 
enrollment. As indicated in 2.2, FAY (Full Academic Year) will be defined this year as 310 half 
days in enrollment. The state intends to transition to October 1 enrollment date next year once 
this data element is added to the End-of-Year file requirements. 

The accountability system properly includes mobile students. 

■ Students that are enrolled for a full academic year in the school will be included in the school 
accountability reporting. 

■ Students that are enrolled for a full academic year in the district will be included in the district 
accountability reporting. 

■ All students will be included in the state accountability reporting. This includes all students 
enrolled in the state on the first day of testing. 
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PRINCIPLE 3. State definition of AYP is based on expectations for growth in 
student achievement that is continuous and substantial, such that all students 
are proficient in reading/language arts and mathematics no later than 2013-2014. 



CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


3.1 How does the State’s 

definition of adequate yearly 
progress require all students 
to be proficient in 
reading/language arts and 
mathematics by the 201 3- 
2014 academic year? 


The State has a timeline for 
ensuring that all students will 
meet or exceed the State’s 
proficient level of academic 
achievement in reading/language 
arts 3 and mathematics, not later 
than 2013-2014. 


State definition does not require 
all students to achieve 
proficiency by 2013-2014. 

State extends the timeline past 
the 201 3-2014 academic year. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



RSA 193-1-1:2 states “On or before the 2013-1024 school year, schools shall ensure that all pupils are 
performing at the basic level or above on the statewide assessment as established in RSA 193-C.” This 
law, though not yet updated to reflect proficiency definitions consistent with NECAP, indicates that 
schools have until 2013-2014 school year to ensure that all students are proficient (Basic or above was 
consistent with our previous assessment system. Levels 3 and 4 on NECAP indicate proficiency.) This 
law will be updated to reflect the new assessment system. 

Starting points and yearly expectations are figured separately for ELA and mathematics and applied to all 
elementary and middle schools. 

Please see the chart included in Section 3.2c 

Proficient (Level 3) was defined in the following manner. At the time of the first full implementation of the 
NECAP test (October 2005), teachers were asked to judge the extent to which their new students were 
ready to succeed at grade level (as defined by newly adopted grade-level expectations). This teacher 
judgment data were reviewed for any anomalies, and then after finding none, applied NECAP test items 
to establish tentative bookmarks in the Bookmark Standard Setting method. In January, 2006, 
approximately 100 teachers for each content area were asked to review proposed bookmarks and make 
recommendations of changes. What resulted now defines the level of achievement necessary for 
students to be ready to achieve at grade level. 



3 If the state has separate assessments to cover its language arts standards (e.g., reading and writing), 
the State must create a method to include scores from all the relevant assessments. 
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CRITICAL 

ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


3.2 How does the 
State 

Accountability 
System 
determine 
whether each 
student 

subgroup, public 
school and LEA 
makes AYP? 


For a public school and LEA to make adequate yearly 
progress, each student subgroup must meet or exceed the 
State annual measurable objectives, each student subgroup 
must have at least a 95% participation rate in the statewide 
assessments, and the school must meet the State’s 
requirement for other academic indicators. 

However, if in any particular year the student subgroup does 
not meet those annual measurable objectives, the public 
school or LEA may be considered to have made AYP, if the 
percentage of students in that group who did not meet or 
exceed the proficient level of academic achievement on the 
State assessments for that year decreased by 1 0% of that 
percentage from the preceding public school year; that group 
made progress on one or more of the State’s academic 
indicators; and that group had at least 95% participation rate 
on the statewide assessment. 


State uses 
different method 
for calculating 
how public 
schools and LEAs 
make AYP. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 
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3.2 

Confidence Intervals: 

Based on Task Force recommendations, New Hampshire will implement an AYP definition utilizing 
confidence intervals. Assessment scores vary each year for at least two reasons unrelated to what 
students know and are able to do: cohort variation (sampling error), and measurement error. Both affect 
school performance independently from the quality of teaching and learning. New Hampshire intends to 
make AYP decisions in a valid and reliable manner. By utilizing confidence intervals, cell size becomes a 
matter of policy rather than statistics. Please see the next page for a description of options for calculating 
confidence intervals. Initial discussions seem to indicate a favor for the bootstrap method. As we 
indicate below, once we decide on a method, we will forward our proposal to the USED. 

Cell Size: 

Consistent with the agreement between USED and NHDOE, New Hampshire will use a cell size of 1 1 for 
performance. 

New Hampshire intends to continue to use a cell size of 40 for calculation of participation rates. This 
permits some variation in context for small schools in the state. New Hampshire intends to continue to 
use a cell size of 40 for the other indicator: attendance rate. 

Safe harbor: If a school or district fails to meet the annual measurable objective, or if one or more of the 
subgroups fail to meet the annual measurable objective, then the school or district makes adequate 
yearly progress if the percentage of students in that group who did not meet or exceed the proficient level 
of academic achievement of the State assessments for the year decreased by 10% of that percentage 
from the proceeding year; that group made progress on the additional indicators and had at least a 95% 
participation rate on the state assessment. 

To implement this policy this year when comparing NHEIAP results from May 2004 to NECAP results 
from October 2005, New Hampshire proposes to make an “equi-percentile” comparison. The standards 
for proficiency on the two tests are different. We know that 73.3% of the students in grades 3 and 6 
demonstrated proficiency (240 or above) on the May 2004 NHEIAP tests in Reading/LA. And that 
approximately that percent of students scored X37 or above in grades 3-8 on the October 2005 NECAP. 
Similarly, for Math, 77.9% of the students demonstrated proficiency (240 or above) on the May 2004 
NHEIAP test, and that approximately that percent of students scored X34 or above in grades 3-8 on the 
October 2005 NECAP. So, for this year only, New Hampshire proposes to compare the percent below 
240 on the May 2004 NHEIAP to the percent below X37 on the October 2005 NECAP for reading. 
Similarly, New Hampshire proposes to compare the percent below 240 on the May 2004 NHEIAP to the 
percent below X34 on the October 2005 NECAP for mathematics. A made up example is shown below 
for reading. 





May 2004 NHEIAP 


Oct 2005 NECAP 


SH 

Goal 


SH? 


# 

tested 


#< 

240 


% 

below 


# 

tested 


#< 

X37 


% 

below 


Park 

ES 


200 


160 


80 


500 


380 


76 


72 


No 


Elm ES 


100 


70 


70 


400 


250 


62.5 


63 


Yes 



Next year, once we have two years of comparable data, New Hampshire will revert to the more standard 
system of comparing students who are below proficient one year to the next. 
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Index System: 

It is not clear where this fits in, so let’s include it here. New Hampshire proposed to adopt an index 
system. As said before, the goal to get all students to proficiency by school year 2013-2014. An index 
system supports that goal by keeping the end in sight while acknowledging the hard work of teachers and 
rewarding schools for the steady progress by students. 



Achievement Level 


Index Points 


Level 1 : Substantially below 
proficient 


XOO 


0 


la 


20 


lb 


40 


Level 2: Partially Proficient 


2a 


60 


2b 


80 


Level 3: Proficient 

Level 4: Proficient with Distinction 


100 



Publicly released AYP reports will consist of 3 pages. 

Page 1 : Decision page 

Page 2: Participation and Index page 

Page 3: Index computation page 

The Index computation will be provided for the whole school and every subgroup that meets the cell size 
criteria list above. 

As with New Hampshire’s past system, AYP decisions proceed as follows: 

1 . Check participation rate 

2. Check if school index meets starting point 

a. If no, check to see is school’s index within the confidence interval 

i. If no, check to see if school makes safe harbor and other indicator 

3. Check other indicator. 
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Calculating Confidence Intervals 

When calculating the confidence interval around the AMO on an index score metric, one is 
faced with the predicament of how best to estimate the true variability of index scores, in 
particular, at the location of the AMO, for the student population for each school. For status, 
because the decision is a dichotomous one (a student is either proficient or not proficient), the 
true variance at the AMO of the student population is known (the proportion of proficient 
students multiplied by the proportion of students who are not proficient). Things are not as 
simple for index scores. Very little research has been conducted on how best to estimate the true 
population variability of student index scores. 

In statistical calculations, when the population variance is unknown, the sample variance is used 
to estimate the population variance. In this case, the within school variance of observed student 
scores is considered an appropriate estimator: 

var _ X ( ^ ndeX student ~ - indeX school f / 

V M school ~ / n _ 1 ’ 

/ '"^student 

where, mean_index sc h 00 i is the average index score for the school, index stu dent is the index score 
for each student, and ni n d ex _student= the number of index scores for the school of interest. 
However, it is not clear which schools should be used to calculate this estimate. For example, 
one could viably calculate any of the following: 

1. Average within school variance for all schools in the state, 

2. Average within school variance for a sample of schools around the AMO, 

3. Student variance for a sample of schools around the AMO, and 

4. A bootstrap variance estimate for a sample of schools around the AMO. 

Although it is not expected that the above four methods will alter the total number of schools in 
NH that meet AYP, they will likely affect which schools meet AYP. Therefore, we are currently 
under contract with the National Center for Improvement of Educational Assessment (NCIEA) 
to research each of the above four options. As soon as the research is completed, we will 
forward the results and decision to the Department of Education. 
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CRITICAL 

ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


3.2a What is the 
State’s 
starting 
point for 
calculating 
Adequate 
Yearly 
Progress? 


Using data from the 2001-2002 school year, the State 
established separate starting points in reading/language arts 
and mathematics for measuring the percentage of students 
meeting or exceeding the State’s proficient level of academic 
achievement. 

Each starting point is based, at a minimum, on the higher of the 
following percentages of students at the proficient level: (1) the 
percentage in the State of proficient students in the lowest- 
achieving student subgroup; or, (2) the percentage of proficient 
students in a public school at the 20 th percentile of the State’s 
total enrollment among all schools ranked by the percentage of 
students at the proficient level. 

A State may use these procedures to establish separate 
starting points by grade span; however, the starting point must 
be the same for all like schools (e.g., one same starting point 
for all elementary schools, one same starting point for all 
middle schools...). 


The State 
Accountability 
System uses a 
different method for 
calculating the 
starting point (or 
baseline data). 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



To determine the method and conditions for defining the Starting Points for AYP: 

Federal guidelines were followed for both ELA and mathematics (computing 20% enrollment method). 
Files are available upon request. 



Starting Points (based on Oct 2005 NECAP results) 




Index 




Grades 3-8 


English language arts 


82 


Mathematics 


76 
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CRITICAL 

ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


3.2b What are the 
State’s annual 
measurable 
objectives for 
determining 
adequate 
yearly 
progress? 


State has annual measurable objectives that are 
consistent with a state’s intermediate goals and that 
identify for each year a minimum percentage of 
students who must meet or exceed the proficient level 
of academic achievement on the State’s academic 
assessments. 

The State’s annual measurable objectives ensure that 
all students meet or exceed the State’s proficient level 
of academic achievement within the timeline. 


The State Accountability 
System uses another 
method for calculating 
annual measurable 
objectives. 

The State Accountability 
System does not include 
annual measurable 
objectives. 




The State’s annual measurable objectives are the 
same throughout the State for each public school, each 
LEA, and each subgroup of students. 




STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 


The State will use a consistent method for establishing annual measurable objectives based on the 
starting point and an eight year timeline. It will be applied to all subgroups, schools, LEAs and the State, 
(see 3.2c for a table that includes annual measurable objectives) 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


3.2c What are the State’s 
intermediate goals for 
determining adequate 
yearly progress? 


State has established 
intermediate goals that increase 
in equal increments over the 
period covered by the State 
timeline. 

• The first incremental 

increase takes effect not 
later than the 2004-2005 
academic year. 


The State uses another method 
for calculating intermediate goals. 

The State does not include 
intermediate goals in its definition 
of adequate yearly progress. 




• Each following incremental 
increase occurs within 
three years. 





STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



The index goals are set separately for English language arts and mathematics for grades three through 
eight. 



Grades 3-8 


Index 




ELA 


Math 


Starting point (2005-2006) 


82 


76 


2006-2007 


82 


76 


2007-2008 


86 


82 


2008-2009 


86 


82 


2009-2010 


91 


88 


2010-2011 


91 


88 


2011-2012 


95 


94 


2012-2013 


95 


94 


2013-2014 


100 


100 
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PRINCIPLE 4. State makes annual decisions about the achievement of all public 
schools and LEAs. 



CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


4.1 How does the State 
Accountability System 
make an annual 
determination of whether 
each public school and LEA 
in the State made AYP? 


AYP decisions for each public 
school and LEA are made 
annually. 4 


AYP decisions for public schools 
and LEAs are not made annually. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



AYP decisions will be made annually for each public school and all school districts that operate schools in 
New Hampshire. (New Hampshire has approximately 12 school districts that do not operate schools but 
choose to tuition them to other school districts.) The State will produce an AYP report for each school 
and school district in the state. The State will publish the list of schools and districts that are in need of 
improvement on its web site. Schools that do not meet the cell size for pupil reporting will be given an 
AYP designation based on a visit - a small school protocol based primarily an academic indicators will be 
used. 

Small school protocol: New Hampshire had 14 “small schools” in the 2002-2003 school year. With every 
year testing, the number of small schools should decrease. A few may remain. These schools have a 
total enrollment of less than 10 students in many grades and may not meeting the minimum N 
requirements. A “Small School Review Team” will review school data in these schools during the month 
of August. The team will evaluate summative student performance data based on, but not limited to, the 
following: the two most recent years of statewide assessment data, norm reference test, and other 
standards based assessment tools used by the school such as Reading Running Records, Reading First 
assessments, Reading Excellence assessments, and mathematics performance assessments. The 
review process will be a collaborative effort between the department and the school/district, and include 
school improvement, accountability, and curriculum and assessment consultants. Based on the evidence 
from the review process, the final report will indicate whether the school is meeting the annual 
measurable objectives in each content area. An AYP determination will be made at that point. 



4 Decisions may be based upon several years of data and data may be averaged across grades within a 
public school [§1111 (b)(2)(J)]. 
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PRINCIPLE 5. All public schools and LEAs are held accountable for the 
achievement of individual subgroups. 

EXAMPLES FOR 

CRITICAL ELEMENT MEETING REQUIREMENTS 



5.1 How does the definition of Identifies subgroups for defining 
adequate yearly progress adequate yearly progress: 
include all the required economically disadvantaged, 
student subgroups? major racial and ethnic groups, 

students with disabilities, and 
students with limited English 
proficiency. 

Provides definition and data 
source of subgroups for adequate 
yearly progress. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



All public schools and school districts will be accountable for the performance of student subgroups - 
including major racial/ethnic subgroups, students with disabilities, limited English proficient students, 
and economically disadvantaged students - through AYP determination, provided the subgroup meets 
the minimum group size requirement. 

Starting with the administration of the NH State Assessment for the 2001-2002 school year, New 
Hampshire collected and disaggregated the data on each required subgroup for AYP, enabling school 
districts to compare achievement levels and plan instructional interventions. School districts receive a 
report for each of its schools containing the required disaggregated data. 

This will continue with the new assessment results. 



EXAMPLES OF 

NOT MEETING REQUIREMENTS 



State does not disaggregate data 
by each required student 
subgroup. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 

NOT MEETING REQUIREMENTS 


5.2 How are public schools 
and LEAs held 
accountable for the 
progress of student 
subgroups in the 
determination of adequate 
yearly progress? 


Public schools and LEAs are held 
accountable for student subgroup 
achievement: economically 
disadvantaged, major ethnic and 
racial groups, students with 
disabilities, and limited English 
proficient students. 


State does not include student 
subgroups in its State 
Accountability System. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



New Hampshire requires that schools and districts report student race, ethnicity, gender, disability status, 
migrant status, English proficiency and economic status along with student assessment results. 

New Hampshire will disaggregate and hold schools and LEAs accountable for the performance of the 
following student subgroups that meet the minimum cell size requirement for accountability purposes: 

All Students 

Major Racial/Ethnic Groups: Asian, Black, White, Hispanic, Native American 

Economically Disadvantaged: Identified as eligible for Free and Reduced Priced Meal Program under 
the USDA National School Lunch Act. 

Limited English Proficient: Students who exhibit limited comprehension of English in one or more of 
the four domains of listening, speaking, reading or writing. 

Students with Disabilities: As defined under section 602(3) of the Individuals with Disabilities Act. 

For each school and LEA, the State will determine for each subgroup of sufficient size whether the 
subgroup achieved the annual measurable objective or met the “Safe Harbor” provision of NCLB and met 
the 95% participation rate criteria. For a school or LEA to make AYP, every group for which a school or 
LEA is accountable must make AYP. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 

NOT MEETING REQUIREMENTS 


5.3 How are students with 


All students with disabilities 


The State Accountability System or State policy 


disabilities included in the 


participate in statewide 


excludes students with disabilities from 


State’s definition of 


assessments: general 


participating in the statewide assessments. 


adequate yearly progress? 


assessments with or without 
accommodations or an alternate 
assessment based on grade level 
standards for the grade in which 
students are enrolled. 

State demonstrates that students 
with disabilities are fully included 
in the State Accountability 
System. 


State cannot demonstrate that alternate 
assessments measure grade-level standards for 
the grade in which students are enrolled. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 
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EXAMPLES FOR 


EXAMPLES OF 


CRITICAL ELEMENT 


MEETING REQUIREMENTS 


NOT MEETING REQUIREMENTS 



All students with disabilities in New Hampshire participate in the regular assessment New England Common 
Assessment Program (NECAP), or the New Hampshire Alternate Assessment (NH-Alt). Students with disabilities 
participating in these assessments, with or without accommodations, are included in the State’s definition of AYP in the 
same manner as students without disabilities. 

Each student’s Individualized Education Program (IEP) team determines how the student will participate in the state 
assessment program. The state has developed participation guidelines for IEP teams to use as they make participation 
decisions. These guidelines stress factors such as cognitive ability and adaptive behavior skill levels. The student’s IEP 
team meets prior to the state assessment to determine the nature of the student’s participation for each assessment 
used. Students with disabilities may take: 

■ the assessment without accommodations, under conditions routinely used; 

■ the assessment with accommodations; or 

■ NH-Alt for students with disabilities who meet the criteria for alternate assessment. 

NH-Alt is intended for a very small percentage of students who require significantly different instructional and 
technological supports to measure the progress in their learning. Alternate achievement standards were generated by 
convening a panel of school district personnel to identify the essential core of the content standards in English language 
arts and mathematics. Students are scored using the same performance labels as those in the general statewide 
assessment system: Proficient with Distinction (level 4), Proficient (level 3), Partially Proficient (level 2), Substantially 
Below Proficient (level 1). A student’s portfolio is judged as demonstrating acceptable performance if it earns a score of 
proficient or better. Scores from the portfolio assessment and regular assessment are reported separately and 
combined when reporting accountability results. 

Students participating in NH-Alt receive a score that reflects the student’s performance of skills. The score will be 
converted to the achievement levels currently used in New Hampshire to determine AYP and incorporated into the AYP 
calculation. 

New Hampshire will ensure that the use of the alternate assessments (NH-Alt) will comply with the 1% p ercent proficient 
limit allowable and the eligibility criteria deemed permissible, as a result of the final federal regulations for accountability 
and assessment. 

For AYP considerations based on 2006 test results for use during the 2006-2007 academic year, New Hampshire will 
implement the flexibility described in Transition Option 1 of Education Secretary Margaret Spellings’ letter of May 10, 
2005. After calculating subgroup AYP using New Hampshire’s approved accountability plan, schools or districts not 
making AYP as a result of only their SWD subgroup math and/or ELA percent proficient will be re-evaluated. The state 
will calculate the proxy amount by dividing 2% by the percentage of SWD students in the state population in fall 2005 
(estimate 1 5.6% of the testing population). This percent will then be multiplied by the number of students in the SWD 
group, (rounded up to the next whole number of students), and added at full value when recalculating the index for the 
group. And compared to the 2006 AMOs. No confidence intervals will be applied in these steps, and schools or districts 
that do not meet the AMOs will be considered to have failed subgroup AYP. Schools and districts that do meet the AMO 
will then be designated as not making AYP. 



27 



CONSOLIDATED STATE APPLICATION ACCOUNTABILITY WORKBOOK 



CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


5.4 How are students 


All LEP student participate in statewide assessments: 


LEP students are 


with limited English 


general assessments with or without accommodations 


not fully included 


proficiency included 


or a native language version of the general 


in the State 


in the State’s 


assessment based on grade level standards. 


Accountability 


definition of adequate 
yearly progress? 


State demonstrates that LEP students are fully 
included in the State Accountability System. 


System. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



New Hampshire expects all students enrolled in grades 3-8 to participate in the statewide assessment at 
those grade levels. This includes LEP students. New Hampshire has a very small population of LEP 
students. The LEP students represent less than 2% of the total student population. With over 150 
languages spoken by LEP students in our public schools, it is not practicable for New Hampshire to offer 
native language assessments as part of the NHEIAP. LEP students who have been enrolled less than 1 0 
months in US schools are exempt from the Reading test, but must participate in the mathematics test. 
These students are counted as participating in reading, but are counted as participating in mathematics 
only if they do so. All LEP students are required to participate in a test of English language proficiency in 
addition to the state-wide assessment. 

Accommodations are provided to LEP students in order to facilitate their participation in the statewide 
assessment. New Hampshire requires schools and districts to identify LEP students when reporting 
student assessment results. A wide range of accommodations are available for all students (see 
Accommodation: Guidelines and Procedures). Standard procedures and guidelines for determining 
which accommodations are appropriate for LEP students have been developed and are being used by 
school districts. One particular accommodation for LEP students is available: C-12 Word-to-word 
translation dictionary, nonelectronic with no definitions (For ELL students in Mathematics and Writing 
only) Approved accommodations do not affect student scores. 

New Hampshire is studying new ways to assess LEP student’s English proficiency that would allow us to 
judge their performance relative to our ELA curriculum standards. In addition, we are seeking help in 
assessing LEP student’s proficiency in mathematics through our collaboration with the New England 
Compact. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 

NOT MEETING REQUIREMENTS 


5.5 What is the State's 

definition of the minimum 
number of students in a 
subgroup required for 
reporting purposes? For 
accountability purposes? 


State defines the number of 
students required in a subgroup 
for reporting and accountability 
purposes, and applies this 
definition consistently across the 
State. 5 

Definition of subgroup will result in 
data that are statistically reliable. 


State does not define the required 
number of students in a subgroup 
for reporting and accountability 
purposes. 

Definition is not applied 
consistently across the State. 

Definition does not result in data 
that are statistically reliable. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Minimum n for reporting and accountability at the school and district level, and to all subgroups within... 



• 40 - participation rate 

• 40 - attendance rate 

• 1 1 - for performance 



5 The minimum number is not required to be the same for reporting and accountability. 



29 





CONSOLIDATED STATE APPLICATION ACCOUNTABILITY WORKBOOK 



CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 

NOT MEETING REQUIREMENTS 


5.6 How does the State 
Accountability System 
protect the privacy of 
students when reporting 
results and when 
determining AYP? 


Definition does not reveal 
personally identifiable 
information. 6 


Definition reveals personally 
identifiable information. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 


New Hampshire State Law (1 93-C:1 1 ) states “Individual names or codes contained in the statewide 
assessment results, scores, or other evaluative materials shall be deleted for the purposes of records 
maintenance and storage of such results or scores at the Department of Education, unless a parent or 
legal guardian provides written authorization, or as required under federal law.” Such student identifiers 
reside within the individual schools and the assessment contractor. School and district scores are not 
reported publicly when the scores are based on fewer than 10 students. In addition, the Department will 
not report summative performance for a group or subgroup at less than 1 0% nor greater than 90% if such 
reporting would compromise the confidentiality of students. 



6 The Family Education Rights and Privacy Act (FERPA) prohibits an LEA that receives Federal funds 
from releasing, without the prior written consent of a student’s parents, any personally identifiable 
information contained in a student’s education record. 
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PRINCIPLE 6. State definition of AYP is based primarily on the State’s academic 
assessments. 



CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


6.1 How is the State’s 


Formula for AYP shows that 


Formula for AYP shows that 


definition of adequate 


decisions are based primarily on 


decisions are based primarily on 


yearly progress based 


assessments. 7 


non-academic indicators or 


primarily on academic 




indicators other than the State 


assessments? 


Plan clearly identifies which 
assessments are included in 
accountability. 


assessments. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



In 1993, New Hampshire passed legislation that enacted the statewide education and improvement 
program The aim of this program was to define what students should know and be able to do, develop 
and implement methods for assessing that learning and its application, report assessment results to all 
citizens of New Hampshire, help provide accountability at all levels, and to use the results, at both state 
and local levels, to improve instruction and advance student learning. This legislation produced the New 
Hampshire curriculum frameworks and an assessment system called New Hampshire Educational 
Improvement and Assessment Program (NHEIAP). An excerpt from the law reflects its intent: “At each 
grade level assessed, the standards and expectations shall be the same for every New Hampshire 
student.” It is this historical context that provides the basis as we move forward. Adequate Yearly 
Progress (AYP) will be based primarily on the Reading and mathematics scores derived from the 
statewide assessments given at grades 3-8. 

The 95% participation rate will be derived from assessment data. Currently our statewide participation 
rate is over 95%. The 90% attendance rate will be derived from attendance records submitted to the 
state. 



7 State Assessment System will be reviewed by the Standards and Assessments Peer Review Team. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 

NOT MEETING REQUIREMENTS 


7.1 What is the State’s 
additional academic 
indicator for public 
elementary schools for the 
definition of AYP? For 
public middle schools for 
the definition of AYP? 


State defines the additional 
academic indicators, e.g., 
additional State or locally 
administered assessments not 
included in the State assessment 
system, grade-to-grade retention 
rates or attendance rates. 8 


State has not defined an 
additional academic indicator for 
elementary and middle schools. 




An additional academic indicator 
is included (in the aggregate) for 
AYP, and disaggregated (as 
necessary) for use when applying 
the exception clause to make 
AYP. 





STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



New Hampshire will use attendance rates as the other indicator. Attendance rate has been defined as the 
Average Daily Membership (ADM) reported to the NH Department of Education. Any school with an 
attendance rate lower than 90% will not make AYP. 

Attendance rate is included (in the aggregate) for AYP, and disaggregated (as necessary) for use when 
applying the exception clause to make AYP [See USC 631 1(b)(2)(l)(i) and 34 CFR 200.20(b)]. 

Attendance as the other indicator is reflected in New Hampshire’s single state accountability legislation - 
now Chapter 314 of the Laws of 2003. Section 314:6 is the accountability portion of the bill. It creates a 
new chapter in our statutes, RSA 1 93-H. The legislation took effect on July 22, 2003. 



8 NCLB only lists these indicators as examples. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 

NOT MEETING REQUIREMENTS 


7.2 Are the 
State’s 
academic 


State has defined academic 
indicators that are valid and reliable. 


State has an academic indicator that is not 
valid and reliable. 


indicators 
valid and 
reliable? 


State has defined academic 
indicators that are consistent with 
nationally recognized standards, if 
any. 


State has an academic indicator that is not 
consistent with nationally recognized 
standards. 

State has an academic indicator that is not 
consistent within grade levels. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



The NH DOE has contracted with the National Center for the Improvement of Educational Assessment 
(NCIEA) to establish an Assessment/ Accountability Technical Advisory Committee. It will be the 
responsibility of this group to review all academic indicators for validity and reliability. Currently, 
reliabilities for all mathematics assessment are .90 or greater, .88 or greater for reading. 
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PRINCIPLE 8. AYP is based on reading/language arts and mathematics 
achievement objectives. 



CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


8.1 Does the state measure 
achievement in 
reading/language arts and 
mathematics separately for 
determining AYP? 


State AYP determination for 
student subgroups, public 
schools and LEAs separately 
measures reading/language arts 
and mathematics. 9 

AYP is a separate calculation for 
reading/language arts and 
mathematics for each group, 
public school, and LEA. 


State AYP determination for 
student subgroups, public 
schools and LEAs averages or 
combines achievement across 
reading/language arts and 
mathematics. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 


Currently the state assessment (NECAP) measures student performance in reading and mathematics 
separately at grades 3-8. Accountability measures will be reported for student subgroups, public schools 
and LEAs in reading and mathematics separately. 



9 If the state has more than one assessment to cover its language arts standards, the State must create a 
method for including scores from all the relevant assessments. 
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PRINCIPLE 9. State Accountability System is statistically valid and reliable. 





EXAMPLES FOR 


EXAMPLES OF 


CRITICAL 


MEETING REQUIREMENTS 


NOT MEETING 


ELEMENT 




REQUIREMENTS 


9.1 HowdoAYP 


State has defined a method for determining an 


State does not have an 


determination 


acceptable level of reliability (decision 


acceptable method for 


s meet the 


consistency) for AYP decisions. 


determining reliability (decision 


State’s 




consistency) of accountability 


standard for 


State provides evidence that decision 


decisions, e.g., it reports only 


acceptable 


consistency is (1) within the range deemed 


reliability coefficients for its 


reliability? 


acceptable to the State, and (2) meets 
professional standards and practice. 


assessments. 






State has parameters for 




State publicly reports the estimate of decision 


acceptable reliability; however, 




consistency, and incorporates it appropriately 


the actual reliability (decision 




into accountability decisions. 


consistency) falls outside those 
parameters. 




State updates analysis and reporting of 
decision consistency at appropriate intervals. 


State’s evidence regarding 
accountability reliability (decision 
consistency) is not updated. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 


AYP determinations will be based primarily on assessment results from the statewide assessment 
system, NECAP. Annually NECAP will go through a complete evaluation of reliability (Standard Errors of 
Measurement, Accuracy and Consistency). The results are published in the NECAP Technical Manual. 


The NH DOE contracts with the NCIEA (National Center for the Improvement of Educational Assessment) 
to coordinate an assessment/accountability Technical Advisory Committee. It is the responsibility of this 
group to review all the academic indicators for validity and reliability and to ensure the integrity of the 


process. 







35 





CONSOLIDATED STATE APPLICATION ACCOUNTABILITY WORKBOOK 



CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


9.2 What is the State's process 
for making valid AYP 
determinations? 


State has established a process 
for public schools and LEAs to 
appeal an accountability decision. 


State does not have a system for 
handling appeals of accountability 
decisions. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



The process for making AYP determinations will be widely publicized (NH DOE website, Superintendent’s 
Key Messages monthly e-mail, New Hampshire NCLB list serve). 

A report of assessment data is sent to all schools for verification prior to its public release. Data from 
schools that will form the basis of our graduation rates and retention rates, data are reviewed and 
confirmed by the superintendents. AYP determinations will be made based on this information and 
reports will be sent to all schools. A school wishing to appeal its AYP designation will have 30 days to 
present an appeal to their district. A district wishing to appeal its AYP designation will have 30 days to 
present an appeal to the Commissioner of Education or his designee. Guidelines for the appeal process 
will appear on the NH DOE website and will be given to every school that has not made AYP. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


9.3 How has the 
State planned for 
incorporating into 
its definition of 
AYP anticipated 
changes in 
assessments? 


State has a plan to maintain continuity in AYP 
decisions necessary for validity through planned 
assessment changes, and other changes 
necessary to comply fully with NCLB. 

State has a plan for including new public schools in 
the State Accountability System. 

State has a plan for periodically reviewing its State 
Accountability System, so that unforeseen changes 
can be quickly addressed. 


State’s transition plan 
interrupts annual 
determination of AYP. 

State does not have a plan 
for handling changes: e.g., 
to its assessment system, 
or the addition of new 
public schools. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 


The NH DOE has contracted with the NCIEA to coordinate a Technical Advisory Committee. It is the 
responsibility of this group to develop policy for anticipated changes to AYP as changes are made to the 
assessment system. The changes contained within this submission result from two external panels: AYP 
Task Force and the TAC. The NCIEA helps to run the meetings of both groups. 



10 Several events may occur which necessitate such a plan. For example, (1) the State may need to 
include additional assessments in grades 3-8 by 2005-2006; (2) the State may revise content and/or 
academic achievement standards; (3) the State may need to recalculate the starting point with the 
addition of new assessments; or (4) the State may need to incorporate the graduation rate or other 
indicators into its State Accountability System. These events may require new calculations of validity and 
reliability. 
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PRINCIPLE 10. In order for a public school or LEA to make AYP, the State 
ensures that it assessed at least 95% of the students enrolled in each subgroup. 



CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


1 0.1 What is the State's method 
for calculating participation 
rates in the State 
assessments for use in 
AYP determinations? 


State has a procedure to 
determine the number of absent 
or untested students (by 
subgroup and aggregate). 

State has a procedure to 
determine the denominator (total 
enrollment) for the 95% 
calculation (by subgroup and 
aggregate). 


The state does not have a 
procedure for determining the 
rate of students participating in 
statewide assessments. 

Public schools and LEAs are not 
held accountable for testing at 
least 95% of their students. 




Public schools and LEAs are held 
accountable for reaching the 95% 
assessed goal. 




STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 


New Hampshire collects student demographic data on every student enrolled on the first day of the 
statewide assessment. Participation rates for every group and subgroup at the school, district, and state 
level will be calculated based on the total enrollment on the first day of testing. Due to the large number 
of small schools and small districts in the state, a cell size for participation rate accountability will be 40. 
Subgroups that fall under the cell size at the school level may still show up at the district level and will 
show up at the state level. New Hampshire does not intend to use confidence intervals on the 95% 
participation requirement. 
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EXAMPLES FOR 


EXAMPLES OF 


CRITICAL ELEMENT 


MEETING REQUIREMENTS 


NOT MEETING 
REQUIREMENTS 


10.2 What is the State’s 


State has a policy that implements the 


State does not have a 


policy for determining 


regulation regarding the use of 95% 


procedure for making this 


when the 95% 


allowance when the group is statistically 


determination. 


assessed requirement 
should be applied? 


significant according to State rules. 





STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



See section 10.1 
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Appendix A 

Required Data Elements for State Report Card 



1111(h)(1)(C) 

1 . Information, in the aggregate, on student achievement at each proficiency level on the State academic 
assessments (disaggregated by race, ethnicity, gender, disability status, migrant status, English 
proficiency, and status as economically disadvantaged, except that such disaggregation shall not be 
required in a case in which the number of students in a category is insufficient to yield statistically reliable 
information or the results would reveal personally identifiable information about an individual student. 

2. Information that provides a comparison between the actual achievement levels of each student 
subgroup and the State’s annual measurable objectives for each such group of students on each of the 
academic assessments. 

3. The percentage of students not tested (disaggregated by the student subgroups), except that such 
disaggregation shall not be required in a case in which the number of students in a category is insufficient 
to yield statistically reliable information or the results would reveal personally identifiable information 
about an individual student. 

4. The most recent 2-year trend in student achievement in each subject area, and for each grade level, 
for the required assessments. 

5. Aggregate information on any other indicators used by the State to determine the adequate yearly 
progress of students in achieving State academic achievement standards disaggregated by student 
subgroups. 

6. Graduation rates for secondary school students disaggregated by student subgroups. 

7. Information on the performance of local educational agencies in the State regarding making adequate 
yearly progress, including the number and names of each school identified for school improvement under 
section 1116. 

8. The professional qualifications of teachers in the State, the percentage of such teachers teaching with 
emergency or provisional credentials, and the percentage of classes in the State not taught by highly 
qualified teachers, in the aggregate and disaggregated by high-poverty compared to low-poverty schools 
which (for this purpose) means schools in the top quartile of poverty and the bottom quartile of poverty in 
the State. 
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New Hampshire’s Approved 
Accountability System 
Submitted 
August 24, 2005 

(will be applied to High Schools) 
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PRINCIPLE 1. A single statewide Accountability System applied to all public 
schools and LEAs. 



CRITICAL 

ELEMENT 


EXAMPLES FOR 

MEETING STATUTORY REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


1 .3 How does the 


Every public school and LEA is required to make adequate 


A public school or 


State 


yearly progress and is included in the State Accountability 


LEA is not required to 


Accountability 


System. 


make adequate 


System 
include every 


State has a definition of “public school” and “LEA” for AYP 


yearly progress and is 
not included in the 


public school 


accountability purposes. 


State Accountability 


and LEA in 


• The State Accountability System produces AYP 


System. 


the State? 


decisions for all public schools, including public 
schools with variant grade configurations (e.g., K-12), 
public schools that serve special populations (e.g., 
alternative public schools, juvenile institutions, state 
public schools for the blind) and public charter 
schools. It also holds accountable public schools with 
no grades assessed (e.g., K-2). 


State policy 
systematically 
excludes certain 
public schools and/or 
LEAs. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 
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New Hampshire will produce AYP reports for all public schools. 

In 1993, the New Hampshire Legislature enacted state law RSA 193-C. “There is established within the 
department of education a statewide education improvement and assessment program (New Hampshire 
Educational Improvement and Assessment Program - NHEIAP).” The State requires (RSA 1 93-C:6) all 
public school students in the designated grades (grades 3, 6 and 10) to participate in the assessment 
portion of this program. 

New Hampshire will hold all public schools accountable for adequate yearly progress. New Hampshire 
has surveyed its public schools to make sure that all public alternative programs are connected to the 
existing public school structure. There are no public alternative schools within the state, just as there are 
no charter schools in the state. 

Several New Hampshire schools have no grade level tested within the grade spans included in the 
school. Currently, these schools fall into three grade span categories: K-2, 4-5, and 7-8. In this case, 
schools will inherit school-level data from the school that receives the majority of their students. A study 
of school configurations has been conducted and the main receiving school has been identified for each 
of these sending schools. Once we assess grades 3 through 8, we will have to apply this policy only to K- 
2 schools. 

In addition, New Hampshire has many small schools. Despite the small cell size of 1 1 for school and 
subgroup accountability, several schools are small enough so that their aggregate assessment data is 
confidential. Once we assess all grades 3-8, the number of schools that continue to have fewer than 1 1 
students tested will decrease substantially, but not to zero. New Hampshire proposes to evaluate these 
schools with an on-site visit. The evaluation will be based primarily on student performance data 
including performance on the statewide assessment. Confidential student and school level data will 
remain confidential. The AYP status would become public as would a written rationale for the decision. 

Not all public school students attend public schools in the state. A student is identified as a public school 
student provided public funds are used to pay for his or her education. These students fall within three 
categories. 

4. Public school students who attend public schools out of state: these students are 
included in the assessment and accountability system of the state in which they are 
schooled. State law RSA 193-C:6 details the participation of students involved in 
interstate agreements. 

5. Public school students who attend private in-state schools (usually these students are 
special education students and/or court ordered placements): these students are 
assessed and included in state level aggregate and disaggregate data. There is no 
provision under state or federal law to include private schools in the accountability 
system. Furthermore, these students do not fall within the “enrolled for a full academic 
year” clause for either the sending public school district or appropriate school. 

6. Public school students who attend private out-of-state schools (also usually special 
education students and/or court ordered placements): these students participate in the 
assessment and accountability system for either New Hampshire or the receiving state. 
(Guidelines are established in Procedures for Determining How Each Student Will 
Participate in the New Hampshire Educational Improvement and Assessment Program 
(NHEIAP) available at www.ed.state.nh.us/Assessment/materials.htm) 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING STATUTORY 
REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


1.4 How are all public schools 
and LEAs held to the same 
criteria when making an AYP 
determination? 


All public schools and LEAs are 
systematically judged on the 
basis of the same criteria when 
making an AYP determination. 

If applicable, the AYP definition is 
integrated into the State 
Accountability System. 


Some public schools and LEAs 
are systematically judged on the 
basis of alternate criteria when 
making an AYP determination. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



All public schools and LEAs will be judged on a single AYP definition. AYP will be based on student 
performance on the statewide assessment, 95% participation rate, retention rate at the elementary/middle 
school level and graduation rate at the high school level. This definition has been included in new 
legislation presented to the 2003 New Hampshire Legislature: Public Education Accountability System, an 
act establishing a comprehensive statewide accountability system concerning an adequate education. 

This bill includes the following: 

193-G.2 Statewide Performance Targets. 

I. On or before the 2013-2014 school year, schools shall insure that all pupils are performing at 
the basic level or above on the statewide assessment as established in RSA 193-C. 

II. In addition to the requirements of paragraph I, schools shall meet statewide performance 
targets as established in rules adopted by the state board of education pursuant to RSA 541 -A, 
relative to third grade reading. 

III. In addition to the requirements of paragraph I, schools shall meet statewide performance 
targets as established in rules adopted by the state board of education pursuant to RSA 541 -A, 
relative to the statewide assessment. 

IV. In addition to the requirements of paragraph I, schools shall meet statewide performance 
targets as established in rules adopted by the state board of education pursuant to RSA 541 -A, 
relative to retention rate. 

V. In addition to the requirements of paragraph I, schools shall meet statewide performance 
targets as established in rules adopted by the state board of education pursuant to RSA 541 -A, 
relative to the percentage of pupils who graduate with a regular diploma from an approved high 
school. 

The full text of the bill SB 107 a www.gencourt.state.nh.us/ie/ 
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CRITICAL ELEMENT 


EXAMPLES FOR 

MEETING STATUTORY REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


1 .3 Does the State have, 
at a minimum, a 
definition of basic, 
proficient and 
advanced student 
achievement levels in 
reading/language 
arts and 
mathematics? 


State has defined three levels of student 
achievement: basic, proficient and advanced - 11 

Student achievement levels of proficient and 
advanced determine how well students are 
mastering the materials in the State’s academic 
content standards; and the basic level of 
achievement provides complete information about 
the progress of lower-achieving students toward 
mastering the proficient and advanced levels. 


Standards do not meet 
the legislated 
requirements. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 


The New Hampshire accountability system is based on the New Hampshire Educational Improvement 
and Assessment Program (NHEIAP). The NHEIAP has four clearly defined proficiency levels: novice, 
basic, proficient, and advanced. 

New Hampshire reports assessment data in two forms: proficiency level (advanced, proficient, basic, and 
novice), and scaled score (200-300). The two statistics are connected as follows: advanced (scaled 
scores of 280-300), proficient (scaled scores of 260-278), basic (scaled scores of 240-258), and novice 
(200-238). At the student level, the acceptable performance range is basic or better. Novice represents 
unacceptable performance. 

Proficiency levels for each subject area at each grade level assessed are defined in the annual statewide 
assessment report: Educational Assessment Report. 



11 System of State achievement standards will be reviewed by the Standards and Assessments Peer 
Review. The Accountability Peer Review will determine that achievement levels are used in determining 
AYP. 
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CRITICAL ELEMENT 


EXAMPLES FOR 

MEETING STATUTORY REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


1 .5 How does the 


State provides decisions about adequate yearly progress 


Timeline does not 


State provide 


in time for LEAs to implement the required provisions 


provide sufficient 


accountability and 
adequate yearly 


before the beginning of the next academic year. 


time for LEAs to 
fulfill their 


progress 


State allows enough time to notify parents about public 


responsibilities 


decisions and 


school choice or supplemental educational service options, 


before the 


information in a 


time for parents to make an informed decision, and time to 


beginning of the 


timely manner? 


implement public school choice and supplemental 
educational services. 


next academic 
year. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



It is the Department’s intent to provide accountability reports to all schools in a timely manner. In 
December representatives from the New Hampshire Department of Education met with our state 
assessment vendor, Measured Progress, and developed a multi-year plan to provide accountability 
reports to the schools in a timely manner. 

New Hampshire tests in the late spring (the testing period for 2003 is May 5-16). Standards based 
assessments at grade 3, 6, and 10 include an extended writing prompt in English Language Arts and 
constructed response items in ELA, Mathematics, Science, and Social Studies. Working in conjunction 
with our assessment contractor, the reporting of statewide assessment data has been moved to 
September 18 this year (2003) from mid October last year (2002). School and district level data is 
scheduled to be sent on August 29, 2003. This embargoed data is provided to districts for two reasons: 
(1) to provide districts with an opportunity to double check data prior to wide-spread state release of data, 
and (2) to provide districts with an opportunity to examine results and consider implications prior to the 
public display of data. Our assessment contractor and members of the Center for Assessment (our 
contractor for our Policy Advisory Committee (PAC) and Technical Advisory Committee (TAC)) will assist 
the department in processing pre-release data for two sets of schools: schools in need of improvement (9 
schools currently on the list) and schools in danger of being classified as in need of improvement (21 
schools currently on the list). We intend to have AYP calculations completed for these two sets of 
schools prior to the end of August. 

Those schools that must offer choice for the first time will be required to notify parents in the fall and the 
choice option will become available immediately. Schools already identified as in need of improvement 
will continue to offer choice and adhere to other appropriate sanctions. 

We will work with our assessment contractor to have both assessment results and AYP reports for all 
schools issued prior to the beginning of the school year starting with the 2003-2004 testing cycle. 
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CRITICAL 

ELEMENT 


EXAMPLES FOR 

MEETING STATUTORY REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


1 .6 Does the 


The State Report Card includes all the required data 


The State Report 


State 


elements [see Appendix A for the list of required data 


Card does not include 


Accountability 


elements]. 


all the required data 


System 




elements. 


produce an 


The State Report Card is available to the public at the 




annual State 


beginning of the academic year. 


The State Report 


Report Card? 




Card is not available 




The State Report Card is accessible in languages of major 
populations in the State, to the extent possible. 

Assessment results and other academic indicators 
(including graduation rates) are reported by student 
subgroups 


to the public. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



New Hampshire produces, through enacted legislation (RSA 193-E:3), an annual report card for the 
State, LEAs and all public schools through the NH School District Profiles link on the NH Department of 
Education’s website: www.ed.state.nh.us. It provides easy to understand information about schools and 
communities to the public. New Hampshire law requires the Department to provide attendance and drop- 
out rates; school environmental indicators and safety data; proportion of graduating students going on to 
post-secondary education and military service; and performance on the state assessment (NHEIAP). All 
data and information used to determine AYP will be added to the NH School District Profiles including 
disaggregated data about school performance which is currently sent to the LEAs. The additional data 
elements, regarding teacher information, are currently being collected so that they can also be added to 
the NH School District Profiles. The pending accountability legislation has amended the reporting 
requirements to include NCLB data elements. 

Pending accountability legislation (193-E:3(I)) requires: By August 1, 2003, and annually thereafter, each 
school district shall report data to the department of education, at the school and districts levels for the 
previous school year, on the following indicators, provided that the department shall develop a reasonable 
schedule to phase-in the reporting of data that is not being collected systematically during school year 
2002-2003. 



47 





CONSOLIDATED STATE APPLICATION ACCOUNTABILITY WORKBOOK 



CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING STATUTORY 
REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


1 .7 How does the State 
Accountability System 
include rewards and 
sanctions for public schools 
and LEAs? 12 


State uses one or more types of 
rewards and sanctions, where 
the criteria are: 

• Set by the State; 

• Based on adequate yearly 
progress decisions; and, 

• Applied uniformly across 
public schools and LEAs. 


State does not implement 
rewards or sanctions for public 
schools and LEAs based on 
adequate yearly progress. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 


Rewards and sanctions for all public schools, including Title 1 and Non-Title 1 schools, have been included 
in new legislation presented to the 2003 New Hampshire Legislature: Public Education Accountability 
System. This bill includes language that authorizes the Department to set up a consistent system of 
rewards and sanctions. The bill provides for a system of annual recognition and responses to school 
performance as set forth in rules: to assist local school staff with the analysis and use of school 
performance data, to assist in the implementation of local educational improvement and assessment 
plans, and to provide grants to school districts for local school improvement. This bill does not 
compromise any of the rewards and sanctions described in NCLB for Title 1 schools, however it does limit 
the option of State takeover. 

All Title 1 schools will be held to the requirements of section 1 1 1 6 of No Child Left Behind. 

The full text of the bill SB 107 a www.gencourt.state.nh.us/ie/ 



12 The state must provide rewards and sanctions for all public schools and LEAs for making adequate 
yearly progress, except that the State is not required to hold schools and LEAs not receiving Title I funds 
to the requirements of section 1 1 1 6 of NCLB [§200.1 2(b)(40)]. 
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PRINCIPLE 2. All students are included in the State Accountability System. 



CRITICAL 

ELEMENT 


EXAMPLES FOR 

MEETING STATUTORY REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


2.4 How does the 


All students in the State are included in the State 


Public school students 


State 


Accountability System. 


exist in the State for 


Accountability 




whom the State 


System include 


The definitions of “public school” and “LEA” account 


Accountability System 


all students in 


for all students enrolled in the public school district, 


makes no provision. 


the State? 


regardless of program or type of public school. 





STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



The accountability system includes all students in the grades that are currently assessed under our 
statewide assessment system. The following is taken from page 7 of the 2003 New Hampshire 
Educational Improvement and Assessment Program (NHEIAP) Instruction Manual for Principals/Test 
Coordinators. 

“Ensure that all students in grades 3, 6, and 10 participate in the general NHEIAP without 
accommodation(s), with accommodation(s), or in the NHEIAP -Alt. 

• This includes but is not limited to students with disabilities and limited-English proficient 
students. Refer to the current version of the Procedures for Determining How Each Student Will 
Participate in the NHEIAP and The Alternate Assessment Educator’s Guide, 2002-2003, 
available on the Department’ s Web site at www. ed. state, nh. us . 

• If a student is repeating grade 3 or 6, or is enrolled in grade 10 at the time of the assessment, 
then that student must participate in the NHEIAP. Students may not be excluded because of poor 
academic performance or discipline problems. 

• If parents wish to have home-schooled students ( who are not enrolled in school) take part in the 
NHEIAP, those students must come in to the school during the testing period to do so. If a home- 
schooled student’s parents want to administer the test to their child, they can do so; however, 
school personnel must be present. After the test has been administered, those students ’ response 
booklets should be returned with your school’s test materials. Be sure that the “home-schooled” 
bubble has been darkened on the back cover of each home- schooled student’s response booklet. 
Include the number of participating home-schooled students in the “Home-Schooled” column on 
the Principal’s Certification of Proper Test Administration form. Do not include home-schooled 
students in the school’s enrollment or in the “Home-Schooled” column if they do not take part in 
the NHEIAP. ” 
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CRITICAL 

ELEMENT 


EXAMPLES FOR 
MEETING STATUTORY 
REQUIREMENTS 


EXAMPLES OF 

NOT MEETING REQUIREMENTS 


2.5 How does the 
State define “full 
academic year” 
for identifying 
students in AYP 
decisions? 


The State has a definition of “full 
academic year” for determining 
which students are to be included 
in decisions about AYP. 

The definition of full academic year 
is consistent and applied 
statewide. 


LEAs have varying definitions of “full 
academic year.” 

The State’s definition excludes students 
who must transfer from one district to 
another as they advance to the next grade. 

The definition of full academic year is not 
applied consistently. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 


For the purpose of accountability reporting, a full academic year is defined for students as “students who 
are continuously enrolled in the school /district since the first business day in October. ” The suspension 
of a student does not affect his or her enrollment status. 

The definition of full academic year is consistently applied to all schools and districts statewide. 

This definition may be revisited if the assessment timeframe changes. 
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CRITICAL 

ELEMENT 


EXAMPLES FOR 
MEETING STATUTORY 
REQUIREMENTS 


EXAMPLES OF 

NOT MEETING REQUIREMENTS 


2.6 How does the 
State 

Accountability 

System 

determine which 
students have 
attended the 
same public 
school and/or 
LEA for a full 
academic year? 


State holds public schools 
accountable for students who 
were enrolled at the same 
public school for a full academic 
year. 

State holds LEAs accountable 
for students who transfer during 
the full academic year from one 
public school within the district 
to another public school within 
the district. 


State definition requires students to attend the 
same public school for more than a full 
academic year to be included in public school 
accountability. 

State definition requires students to attend 
school in the same district for more than a full 
academic year to be included in district 
accountability. 

State holds public schools accountable for 
students who have not attended the same 
public school for a full academic year. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 


The accountability system properly includes mobile students. 

■ Students that are enrolled for a full academic year in the school will be included in the school 
accountability reporting. 

■ Students that are enrolled for a full academic year in the district will be included in the district 
accountability reporting. 

■ All students will be included in the state accountability reporting. This includes all students 
enrolled in the state on the first day of testing. 
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PRINCIPLE 3. State definition of AYP is based on expectations for growth in 
student achievement that is continuous and substantial, such that all students 
are proficient in reading/language arts and mathematics no later than 2013-2014. 



CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


3.3 How does the State’s 

definition of adequate yearly 
progress require all students 
to be proficient in 
reading/language arts and 
mathematics by the 201 3- 
2014 academic year? 


The State has a timeline for 
ensuring that all students will 
meet or exceed the State’s 
proficient level of academic 
achievement in reading/language 
arts 13 and mathematics, not later 
than 2013-2014. 


State definition does not require 
all students to achieve 
proficiency by 2013-2014. 

State extends the timeline past 
the 201 3-2014 academic year. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



New Hampshire reports statewide assessment scores in four performance categories: Advanced, 
Proficient, Basic, and Novice. The AYP Task Force recommended that the top three categories define 
acceptable performance at the student level (see below). The AYP Task Force also recommended 
intermediate goals and annual measurable objectives be set to stay constant for three-year intervals as 
follows: 2002-2004, 2005-2007, 2008-201 0, 201 1 -201 3. Additionally, the task force recommended that 
the performance required by this step function be even increments from the starting point to 100%. 

Starting points and yearly expectations are figured separately for ELA and mathematics. Upon 
recommendation of the AYP Task Force, there are separate starting points for elementary/middle schools 
(K-8) and high schools. 

Please see the chart included in Section 3.2c 

Pending accountability legislation (193-G:2) requires that On or before the 2013-2014 school year, 
schools shall ensure that all pupils are performing at the basic level or above on the statewide 
assessment as established in RSA 193-C. 

Define “Proficiency” for New Hampshire: 

In defining proficiency at the student level, the AYP Task Force focused on the NHEIAP proficiency 
levels: Novice, Basic, Proficient, and Advanced. The question to answer was: could the NHEIAP 
reporting terminology be used to meet the federal expectations for defining “proficiency?” The discussion 
centered on the definitions of Basic and Proficient. The task force concluded that consistently over time 
the state had established that students scoring Basic or above were considered to be performing at grade 
level. A study released in 1997 (Cioffi and Carney) noted that Basic and above, when compared to 
specific standardized test results, indicated that the “performing at grade level” statement was justified. 



13 If the state has separate assessments to cover its language arts standards (e.g., reading and writing), 
the State must create a method to include scores from all the relevant assessments. 
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CRITICAL 

ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


3.4 How does the 
State 

Accountability 
System 
determine 
whether each 
student 

subgroup, public 
school and LEA 
makes AYP? 


For a public school and LEA to make adequate yearly 
progress, each student subgroup must meet or exceed the 
State annual measurable objectives, each student subgroup 
must have at least a 95% participation rate in the statewide 
assessments, and the school must meet the State’s 
requirement for other academic indicators. 

However, if in any particular year the student subgroup does 
not meet those annual measurable objectives, the public 
school or LEA may be considered to have made AYP, if the 
percentage of students in that group who did not meet or 
exceed the proficient level of academic achievement on the 
State assessments for that year decreased by 1 0% of that 
percentage from the preceding public school year; that group 
made progress on one or more of the State’s academic 
indicators; and that group had at least 95% participation rate 
on the statewide assessment. 


State uses 
different method 
for calculating 
how public 
schools and LEAs 
make AYP. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 
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New Hampshire formed a Task Force to focus on two specific questions. What minimum number will/should be required for 
subgroup accountability to protect student privacy? What minimum number will/should be required for subgroup accountability to 
ensure statistical significance/reliability? 



Based on Task Force recommendations, New Hampshire will implement an AYP definition utilizing confidence intervals. 
Assessment scores vary each year for at least two reasons unrelated to what students know and are able to do: cohort variation 
(sampling error), and measurement error. Both affect school performance independently from the quality of teaching and learning. 
New Hampshire intends to make AYP decisions in a valid and reliable manner. By utilizing confidence intervals, cell size becomes 
a matter of policy rather than statistics. 

New Hampshire intends to use a cell size of 1 1 for both status and improvement calculations. Aggregated assessment data is not 
released for groups with fewer than 1 1 students. The combination of a confidence interval approach with a minimal cell size allows 
the state to identify underperforming groups and subgroups without penalizing the many small schools in the state for the increased 
variation in yearly assessment results that comes with smaller schools. 

In choosing a level of confidence, New Hampshire examined variation in school performance scores for the period 1998 to 2002. 
Across all grade levels and considering results for both English language arts and Mathematics, the best fit was .99. 



New Hampshire intends to use a cell size of 1 1 in the calculation of performance for District AYP. A district will be identified In Need 
of Improvement if Improvement if both the Elementary/Middle and High School did not make AYP on the District AYP Report and it 
is in the same content area. 

New Hampshire intends to use a cell size of 40 for calculation of participation rates. This permits some variation in context for small 
schools in the state. 

New Hampshire intends to use a cell size of 40 for the other indicators: attendance rate and graduation rate. 

Safe harbor: If a school or district fails to meet the annual measurable objective, or if one or more of the subgroups fail to meet the 
annual measurable objective, then the school or district makes adequate yearly progress if the percentage of students in that group 
who did not meet or exceed the proficient level of academic achievement of the State assessments for the year decreased by 10% 
of that percentage from the proceeding year; that group made progress on the additional indicators and had at least a 95% 
participation rate on the state assessment. 

Most New Hampshire schools have small subgroups. The situation at the district level is not significantly different since many 
districts have only one school for each grade level. To keep these subgroups as visible as possible without compromising 
confidentiality of results, New Hampshire will use a cell size of 1 1 for safe harbor. This poses a problem in detecting with 
confidence a 10% reduction in the percent of students not meeting proficiency given the nature of cohort variation and measurement 
error. We will gather data to decide whether anchored subgroup performance will result in a cumulative improvement. This 
cumulative improvement is figured by reducing by 10% each year from the starting point the percent of students failing to meet 
proficiency expectations. After two years of data, the NH TAC we will make a recommendation on any adjustments to our method of 
calculating safe harbor. 

In Need of Improvement Decision: A School or district will be identified as in need of improvement provided the school or district 
does not make AYP two years in a row in the same subject/ participation rate, or indicator. 
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CRITICAL 

ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


3.2a What is the 
State’s 
starting 
point for 
calculating 
Adequate 
Yearly 
Progress? 


Using data from the 2001-2002 school year, the State 
established separate starting points in reading/language arts 
and mathematics for measuring the percentage of students 
meeting or exceeding the State’s proficient level of academic 
achievement. 

Each starting point is based, at a minimum, on the higher of the 
following percentages of students at the proficient level: (1) the 
percentage in the State of proficient students in the lowest- 
achieving student subgroup; or, (2) the percentage of proficient 
students in a public school at the 20 th percentile of the State’s 
total enrollment among all schools ranked by the percentage of 
students at the proficient level. 

A State may use these procedures to establish separate 
starting points by grade span; however, the starting point must 
be the same for all like schools (e.g., one same starting point 
for all elementary schools, one same starting point for all 
middle schools...). 


The State 
Accountability 
System uses a 
different method for 
calculating the 
starting point (or 
baseline data). 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



To determine the method and conditions for defining the Starting Points for AYP: 

The New Hampshire AYP Task Force recommended creating separate starting points for high schools 
and elementary/middle schools (K-8). Federal guidelines were followed for both ELA and mathematics 
(computing 20% enrollment method compared to subgroup method). In all four cases, the 20% 
enrollment method yielded a higher starting point. 



Starting Points (based on 2002 NHEIAP results) 




% of students meeting proficiency expectations 




Grades 3-8 


High School 


English language arts 


60 


70 


Mathematics 


64 


52 
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CRITICAL 

ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


3.3b What are the 
State’s annual 
measurable 
objectives for 
determining 
adequate 
yearly 
progress? 


State has annual measurable objectives that are 
consistent with a state’s intermediate goals and that 
identify for each year a minimum percentage of 
students who must meet or exceed the proficient level 
of academic achievement on the State’s academic 
assessments. 

The State’s annual measurable objectives ensure that 
all students meet or exceed the State’s proficient level 
of academic achievement within the timeline. 


The State Accountability 
System uses another 
method for calculating 
annual measurable 
objectives. 

The State Accountability 
System does not include 
annual measurable 
objectives. 




The State’s annual measurable objectives are the 
same throughout the State for each public school, each 
LEA, and each subgroup of students. 




STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 


The State will use a consistent method for establishing annual measurable objectives based on the 
starting point and a twelve year timeline. It will be applied to all subgroups, schools, LEAs and the State, 
(see 3.2c for a table that includes annual measurable objectives) 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


3.2c What are the State’s 
intermediate goals for 
determining adequate 
yearly progress? 


State has established 
intermediate goals that increase 
in equal increments over the 
period covered by the State 
timeline. 

• The first incremental 

increase takes effect not 
later than the 2004-2005 
academic year. 


The State uses another method 
for calculating intermediate goals. 

The State does not include 
intermediate goals in its definition 
of adequate yearly progress. 




• Each following incremental 
increase occurs within 
three years. 





STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



The AYP Task Force recommended that the intermediate goals be set at years 2005, 2008, 201 1 and 
2014. Each one increases by one quarter of the difference between the starting point and 100%. 

The goals are set separately for English language arts and mathematics for grades three through eight 
and high school. 



Annual Measurable Objectives and Intermediate Goals 




Grades 3-8 


High School 




ELA 


Math 


ELA 


Math 


Starting point (2002) 


60 


64 


70 


52 


2003 


60 


64 


70 


52 


2004 


60 


64 


70 


52 


2005 


70 


73 


77 


64 


2006 


70 


73 


77 


64 


2007 


70 


73 


77 


64 


2008 


80 


82 


85 


76 


2009 


80 


82 


85 


76 


2010 


80 


82 


85 


76 


2011 


90 


91 


92 


88 


2012 


90 


91 


92 


88 


2013 


90 


91 


92 


88 


2014 


100 


100 


100 


100 
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PRINCIPLE 4. State makes annual decisions about the achievement of all public 
schools and LEAs. 



CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


4.2 How does the State 
Accountability System 
make an annual 
determination of whether 
each public school and LEA 
in the State made AYP? 


AYP decisions for each public 
school and LEA are made 
annually. 14 


AYP decisions for public schools 
and LEAs are not made annually. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



AYP decisions will be made annually for each public school and all school districts that operate schools in 
New Hampshire. (New Hampshire has approximately 12 school districts that do not operate schools but 
choose to tuition them to other school districts.) Beginning with the 2002-2003 state assessment data, 
the State will produce an AYP report for each school and school district in the state. The State will 
publish the list of schools and districts that are in need of improvement on its web site. Schools that do 
not meet the cell size for pupil reporting will be given an AYP designation based on a visit - a small 
school protocol based primarily an academic indicators will be used. 

Small school protocol: New Hampshire has 14 “small schools” in the 2002-2003 school year. These 
schools have a total enrollment of less than 1 1 students in the grades tested. A “Small School Review 
Team” will review school data in these schools during the month of August. The team will evaluate 
summative student performance data based on, but not limited to, the following: the two most recent 
years of statewide assessment data, norm reference test, and other standards based assessment tools 
used by the school such as Reading Running Records, Reading First assessments, Reading Excellence 
assessments, and mathematics performance assessments. The review process will be a collaborative 
effort between the department and the school/district, and include school improvement, accountability, 
and curriculum and assessment consultants. Based on the evidence from the review process, the final 
report will indicate whether the school is meeting the annual measurable objectives in each content area. 
An AYP determination will be made at that point. 



14 Decisions may be based upon several years of data and data may be averaged across grades within a 
public school [§1111 (b)(2)(J)]. 
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PRINCIPLE 5. All public schools and LEAs are held accountable for the 
achievement of individual subgroups. 



CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 

NOT MEETING REQUIREMENTS 


5.7 How does the definition of 
adequate yearly progress 
include all the required 
student subgroups? 


Identifies subgroups for defining 
adequate yearly progress: 
economically disadvantaged, 
major racial and ethnic groups, 
students with disabilities, and 
students with limited English 
proficiency. 

Provides definition and data 
source of subgroups for adequate 
yearly progress. 


State does not disaggregate data 
by each required student 
subgroup. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 


All public schools and school districts will be accountable for the performance of student subgroups - 
including major racial/ethnic subgroups, students with disabilities, limited English proficient students, 
and economically disadvantaged students - through AYP determination, provided the subgroup meets 
the minimum group size requirement. 

Starting with the administration of the NH State Assessment for the 2001-2002 school year, New 
Hampshire collected and disaggregated the data on each required subgroup for AYP, enabling school 
districts to compare achievement levels and plan instructional interventions. School districts receive a 
report for each of its schools containing the required disaggregated data. See attachment 

Disaggregated Data Report. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 

NOT MEETING REQUIREMENTS 


5.8 How are public schools 
and LEAs held 
accountable for the 
progress of student 
subgroups in the 
determination of adequate 
yearly progress? 


Public schools and LEAs are held 
accountable for student subgroup 
achievement: economically 
disadvantaged, major ethnic and 
racial groups, students with 
disabilities, and limited English 
proficient students. 


State does not include student 
subgroups in its State 
Accountability System. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



New Hampshire requires that schools and districts report student race, ethnicity, gender, disability status, 
migrant status, English proficiency and economic status along with student assessment results. 

New Hampshire will disaggregate and hold schools and LEAs accountable for the performance of the 
following student subgroups that meet the minimum cell size requirement for accountability purposes: 

All Students 

Major Racial/Ethnic Groups: Asian, Black, White, Hispanic, Native American 

Economically Disadvantaged: Identified as eligible for Free and Reduced Priced Meal Program under 
the USDA National School Lunch Act. 

Limited English Proficient: Students who exhibit limited comprehension of English in one or more of 
the four domains of listening, speaking, reading or writing. 

Students with Disabilities: As defined under section 602(3) of the Individuals with Disabilities Act. 

For each school and LEA, the State will determine for each subgroup of sufficient size whether the 
subgroup achieved the annual measurable objective or met the “Safe Harbor” provision of NCLB and met 
the 95% participation rate criteria. For a school or LEA to make AYP, every group for which a school or 
LEA is accountable must make AYP. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 

NOT MEETING REQUIREMENTS 


5.9 How are students with 


All students with disabilities 


The State Accountability System or State policy 


disabilities included in the 


participate in statewide 


excludes students with disabilities from 


State’s definition of 


assessments: general 


participating in the statewide assessments. 


adequate yearly progress? 


assessments with or without 
accommodations or an alternate 
assessment based on grade level 
standards for the grade in which 
students are enrolled. 

State demonstrates that students 
with disabilities are fully included 
in the State Accountability 
System. 


State cannot demonstrate that alternate 
assessments measure grade-level standards for 
the grade in which students are enrolled. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 
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EXAMPLES OF 


CRITICAL ELEMENT 


MEETING REQUIREMENTS 


NOT MEETING REQUIREMENTS 



All students with disabilities in New Hampshire participate in the regular assessment, New Hampshire Educational 
Assessment and Improvement Program (NHEIAP)/New England Common Assessment Program (NECAP), or the New 
Hampshire Alternate Assessment (NH-AA). Students with disabilities participating in regular assessments, with or 
without accommodations, are included in the State’s definition of AYP in the same manner as students without 
disabilities. 



Each student’s Individualized Education Program (IEP) team determines how the student will participate in the state 
assessment program. The state has developed participation guidelines for IEP teams to use as they make participation 
decisions. These guidelines stress factors such as cognitive ability and adaptive behavior skill levels. The student’s IEP 
team meets prior to the state assessment to determine the nature of the student’s participation for each assessment 
used. Students with disabilities may take: 

■ the assessment without accommodations, under conditions routinely used; 

■ the assessment with accommodations; or 

■ NH-AA for students with disabilities who meet the criteria for alternate assessment. 

NH-AA is intended for a very small percentage of students who require significantly different instructional and 
technological supports to measure the progress in their learning. Alternate achievement standards were generated by 
convening a panel of school district personnel to identify the essential core of the content standards in English language 
arts and mathematics. Students are scored using the same performance labels as those in the regular statewide 
assessment system: advanced, proficient, basic, and novice. A student’s portfolio is judged as demonstrating 
acceptable performance if it earns a score of basic or better. Scores from the portfolio assessment and regular 
assessment are reported both separately and combined when reporting assessment results. 

Students participating in NH-AA receive a score that reflects the student’s performance of skills. The score will be 
converted to the achievement levels currently used in New Hampshire to determine AYP and incorporated into the AYP 
calculation. 

New Hampshire will ensure that the use of the alternate assessments (NH-AA) will comply with the 1% percent proficient 
limit allowable and the eligibility criteria deemed permissible, as a result of the final federal regulations for accountability 
and assessment. 

For AYP considerations based on spring 2005 (high school) test results for use during the 2005-2006 academic year and 
for the fall 2005 (elementary and middle schools) test results for use during the 2006/2007 academic year, New 
Hampshire will implement the flexibility described in Transition Option 1 of Education Secretary Margaret Spellings’ 
letter of May 10, 2005. After calculating subgroup AYP using New Hampshire’s approved accountability plan, schools or 
districts not making AYP as a result of only their SWD subgroup math and/or ELA percent proficient will be re-evaluated. 
The state will calculate the proxy amount by dividing 2% by the percentage of SWD students in the state population in 
spring 2005 (estimate 15.6% of the testing population). This proxy value will then be added to the appropriate percent 
proficient values for the schools or districts SWD subgroup and the sums compared to the 2005 AMOs. No confidence 
intervals will be applied in these steps, and schools or districts that do not meet the AMOs will be considered to have 
failed subgroup AYP. Schools and districts that do meet the AMO will then be designated as not making AYP. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


5.1 OHow are students 


All LEP student participate in statewide assessments: 


LEP students are 


with limited English 


general assessments with or without accommodations 


not fully included 


proficiency included 


or a native language version of the general 


in the State 


in the State’s 


assessment based on grade level standards. 


Accountability 


definition of adequate 
yearly progress? 


State demonstrates that LEP students are fully 
included in the State Accountability System. 


System. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



New Hampshire expects all students enrolled in grades 3, 6, or 10 to participate in the statewide 
assessment. This includes LEP students. New Hampshire has a very small population of LEP students. 
The LEP students represent 1 .58 % of the total student population. With over 150 languages spoken by 
LEP students in our public schools, it is not practicable for New Hampshire to offer native language 
assessments as part of the NHEIAP. No student will be exempt from the statewide assessment, including 
LEP students. If an LEP student does not take the state assessment they will be counted as not 
participating. 

Accommodations are provided to LEP students in order to facilitate their participation in the statewide 
assessment. New Hampshire requires schools and districts to identify LEP students when reporting 
student assessment results. A wide range of accommodations are available for all students (see 
Procedures for Determining How Each Student Will Participate in the New Hampshire Educational 
Improvement and Assessment Program (NHEIAP)). Standard procedures and guidelines for determining 
which accommodations are appropriate for LEP students have been developed and are being used by 
school districts. Two particular accommodations for LEP students are available: CIO (with the student 
using a bilingual dictionary or word list for students whose primary language is not English), and D6 (A 
translator/interpreter was used to give directions or ask questions in the student’s native language). 
Approved accommodations do not affect student scores. 

New Hampshire is studying new ways to assess LEP student’s English proficiency that would allow us to 
judge their performance relative to our ELA curriculum standards. In addition, we are seeking help in 
assessing LEP student’s proficiency in mathematics through our collaboration with the New England 
Compact. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 

NOT MEETING REQUIREMENTS 


5.1 1 What is the State's 

definition of the minimum 
number of students in a 
subgroup required for 
reporting purposes? For 
accountability purposes? 


State defines the number of 
students required in a subgroup 
for reporting and accountability 
purposes, and applies this 
definition consistently across the 
State. 15 

Definition of subgroup will result in 
data that are statistically reliable. 


State does not define the required 
number of students in a subgroup 
for reporting and accountability 
purposes. 

Definition is not applied 
consistently across the State. 

Definition does not result in data 
that are statistically reliable. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Minimum n for reporting at the school and district level is 1 1 . 

Minimum n for status and safe harbor calculations is 1 1 . 

Minimum n for participation rate, graduation rate, and retention rate is 40. 

The department acknowledges the mismatch between a cell size of 1 1 for reporting, and a cell size of 40 
for the other indicators: graduation rate and retention rate. Since we are utilizing confidence intervals on 
status, the department is able to report statewide performance results reliably at the low level of 1 1 
students. This is necessary if subgroups are to be visible. The USED has established that confidence 
intervals are not permissible for the other indicators. Thus a larger cell size is necessary to maintain 
reliability. This issue will be addressed at our upcoming TAC meeting in June. With the help of the USED 
and our TAC, we will resolve the issue and notify the USED of the results. 

These definitions are applied to all schools, districts, and the state as a whole. Statistical reliability is 
established through a confidence interval approach. 

See section 3.2 for discussion of status and safe harbor calculations. 



15 The minimum number is not required to be the same for reporting and accountability. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 

NOT MEETING REQUIREMENTS 


5.1 2How does the State 
Accountability System 
protect the privacy of 
students when reporting 
results and when 
determining AYP? 


Definition does not reveal 
personally identifiable 
information. 16 


Definition reveals personally 
identifiable information. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 


New Hampshire State Law (1 93-C:1 1 ) states “Individual names or codes contained in the statewide 
assessment results, scores, or other evaluative materials shall be deleted for the purposes of records 
maintenance and storage of such results or scores at the Department of Education, unless a parent or 
legal guardian provides written authorization, or as required under federal law.” Such student identifiers 
reside within the individual schools and the assessment contractor. School and district scores are not 
reported publicly when the scores are based on fewer than 1 1 students. In addition, the Department will 
not report summative performance for a group or subgroup at less than 1 0% nor greater than 90% if such 
reporting would compromise the confidentiality of students. 



16 The Family Education Rights and Privacy Act (FERPA) prohibits an LEA that receives Federal funds 
from releasing, without the prior written consent of a student’s parents, any personally identifiable 
information contained in a student’s education record. 
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PRINCIPLE 6. State definition of AYP is based primarily on the State’s academic 
assessments. 



CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


6.2 How is the State’s 
definition of adequate 
yearly progress based 
primarily on academic 
assessments? 


Formula for AYP shows that 
decisions are based primarily on 
assessments. 17 

Plan clearly identifies which 
assessments are included in 
accountability. 


Formula for AYP shows that 
decisions are based primarily on 
non-academic indicators or 
indicators other than the State 
assessments. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



In 1993, New Hampshire passed legislation that enacted the statewide education and improvement 
program The aim of this program was to define what students should know and be able to do, develop 
and implement methods for assessing that learning and its application, report assessment results to all 
citizens of New Hampshire, help provide accountability at all levels, and to use the results, at both state 
and local levels, to improve instruction and advance student learning. This legislation produced the New 
Hampshire curriculum frameworks and an assessment system called New Hampshire Educational 
Improvement and Assessment Program (NHEIAP). An excerpt from the law reflects its intent: “At each 
grade level assessed, the standards and expectations shall be the same for every New Hampshire 
student.” It is this historical context that provides the basis as we move forward. Adequate Yearly 
Progress (AYP) will be based primarily on the English language arts and mathematics scores derived 
from the statewide assessments given at grades 3, 6 and 10 (until such time as the state commences the 
annual assessments at the additional grades). 

The 95% participation rate will be derived from assessment data. Currently our statewide participation 
rate is over 95%. 

Graduation rate at high school and retention rate at elementary/middle school will be incorporated into the 
AYP definition. 



17 State Assessment System will be reviewed by the Standards and Assessments Peer Review Team. 
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PRINCIPLE 7. State definition of AYP includes graduation rates for public High schools and an 
additional indicator selected by the State for public Middle and public Elementary schools (such 
as attendance rates). 



CRITICAL 

ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


7.3 What is the 


State definition of graduation rate: 


State definition of 


State 




public high school 


definition for 


• Calculates the percentage of students, measured 


graduation rate does 


the public 


from the beginning of the school year, who graduate 


not meet these 


high school 


from public high school with a regular diploma (not 


criteria. 


graduation 


including a GED or any other diploma not fully 




rate? 


aligned with the state’s academic standards) in the 
standard number of years; or, 

• Uses another more accurate definition that has been 
approved by the Secretary; and 

• Must avoid counting a dropout as a transfer. 

Graduation rate is included (in the aggregate) for AYP, and 
disaggregated (as necessary) for use when applying the 
exception clause 18 to make AYP. 





See USC 631 l(b)(2)(I)(i), and 34 C.F.R. 200.20(b) 
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STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



Currently New Hampshire reports drop-out rates. NH will use a modified NCES definition of graduation 
(does not include GED) rate until such time as a data collection system allows us to gather more accurate 
graduation rates. This will be in effect until the 2005-2006 school year. The Department intends to 
transition to a graduation rate definition consistent with NCLB requirements. 

New Hampshire’s graduation rate will be calculated as the percentage of students who complete high 
school and earn a regular diploma within the standard number of years. The standard numbers of years 
for students with IEP/504 plans are specified in those documents. 

NH Graduation Rate = Completer Rate X Regular Diploma Rate 

Where, 

Completer Rate = 1 00% - Cumulative Dropout Rate% and 

Regular Diploma Rate in the standard # of years = 

# of completers with regular diplomas earned in the standard # of years 
Number of completers with regular + nonstandard diplomas 

The dropout definition is consistent with the NCES definition. Dropouts are defined as students who leave 
school prior to graduation for reasons other than transfer to another school or death of student. 

In New Hampshire, four is the standard number of years for students who do not have lEPs or 504 plans. 
An additional year may be considered for completion to accommodate variations across districts and 
schools including, but not limited to: 

(a) the number of credits required for graduation from public schools, 

New Hampshire Code of Administrative Rules 306.23 establishes a minimum number of credits for 
high school graduation. Many high schools go beyond the minimum number of credits for graduation. 
For example, a student may transfer from a school requiring 20 credits to a school requiring 23 
credits, a public school may not accept all credits from a private school, or variations in course 
offerings may make it necessary for a student to take a few courses during the fifth year. 

(b) the number of credits from private schools that are accepted when a student transfers to a public 
school, and 

(c) the needs of students who are enrolled in Dropout Recovery/Intervention Programs developed at the 
local level. 

Students attending public schools in New Hampshire districts that have an active drop-out recovery 
program may need a fifth year to complete high school graduation requirements. If this is not allowed 
there would be a disincentive to recover students before they permanently drop-out. 

Graduation rate is included (in the aggregate) for AYP, and disaggregated (as necessary) for use when 
applying the exception clause to make AYP [See USC 631 1(b)(2)(l)(i) and 34 CFR 200.20(b)]. 

Graduation rate has been incorporated into the AYP definition in the pending New Hampshire 
Legislature’s Public Education Accountability System Bill. “The percentage of pupils who graduate with a 
regular diploma from an approved high school shall be an indicator of whether a school district has made 
satisfactory progress. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 

NOT MEETING REQUIREMENTS 


7.4 What is the State’s 
additional academic 
indicator for public 
elementary schools for the 
definition of AYP? For 
public middle schools for 
the definition of AYP? 


State defines the additional 
academic indicators, e.g., 
additional State or locally 
administered assessments not 
included in the State assessment 
system, grade-to-grade retention 
rates or attendance rates. 19 


State has not defined an 
additional academic indicator for 
elementary and middle schools. 




An additional academic indicator 
is included (in the aggregate) for 
AYP, and disaggregated (as 
necessary) for use when applying 
the exception clause to make 
AYP. 





STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



New Hampshire will use attendance rates as the other indicator. Attendance rate has been defined as the 
Average Daily Membership (ADM) reported to the NH Department of Education. Any school with an 
attendance rate lower than 95% will not make AYP. 

Attendance rate is included (in the aggregate) for AYP, and disaggregated (as necessary) for use when 
applying the exception clause to make AYP [See USC 631 1(b)(2)(l)(i) and 34 CFR 200.20(b)]. 

Attendance as the other indicator is reflected in New Hampshire’s single state accountability legislation - 
now Chapter 314 of the Laws of 2003. Section 314:6 is the accountability portion of the bill. It creates a 
new chapter in our statutes, RSA 1 93-H. The legislation took effect on July 22, 2003. 



19 NCLB only lists these indicators as examples. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 

NOT MEETING REQUIREMENTS 


7.5 Are the 
State’s 
academic 
indicators 
valid and 
reliable? 


State has defined academic 
indicators that are valid and reliable. 

State has defined academic 
indicators that are consistent with 
nationally recognized standards, if 
any. 


State has an academic indicator that is not 
valid and reliable. 

State has an academic indicator that is not 
consistent with nationally recognized 
standards. 

State has an academic indicator that is not 
consistent within grade levels. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



The NH DOE has contracted with the Center for Assessment to establish an Assessment/Accountability 
Technical Advisory Committee. It will be the responsibility of this group to review all academic indicators 
for validity and reliability. 
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PRINCIPLE 8. AYP is based on reading/language arts and mathematics 
achievement objectives. 



CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


8.2 Does the state measure 
achievement in 
reading/language arts and 
mathematics separately for 
determining AYP? 


State AYP determination for 
student subgroups, public 
schools and LEAs separately 
measures reading/language arts 
and mathematics. 20 

AYP is a separate calculation for 
reading/language arts and 
mathematics for each group, 
public school, and LEA. 


State AYP determination for 
student subgroups, public 
schools and LEAs averages or 
combines achievement across 
reading/language arts and 
mathematics. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 


Currently the state assessment (NHEAIP) measures student performance in English language arts and 
mathematics separately at grades 3, 6, and 10. Accountability measures will be reported for student 
subgroups, public schools and LEAs in English language arts and mathematics separately. We will 
continue to measure and report English language arts and mathematics separately as we transition to 
annual assessments. 



20 If the state has more than one assessment to cover its language arts standards, the State must create 
a method for including scores from all the relevant assessments. 
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PRINCIPLE 9. State Accountability System is statistically valid and reliable. 





EXAMPLES FOR 


EXAMPLES OF 


CRITICAL 


MEETING REQUIREMENTS 


NOT MEETING 


ELEMENT 




REQUIREMENTS 


9.3 HowdoAYP 


State has defined a method for determining an 


State does not have an 


determination 


acceptable level of reliability (decision 


acceptable method for 


s meet the 


consistency) for AYP decisions. 


determining reliability (decision 


State’s 




consistency) of accountability 


standard for 


State provides evidence that decision 


decisions, e.g., it reports only 


acceptable 


consistency is (1) within the range deemed 


reliability coefficients for its 


reliability? 


acceptable to the State, and (2) meets 
professional standards and practice. 


assessments. 






State has parameters for 




State publicly reports the estimate of decision 


acceptable reliability; however, 




consistency, and incorporates it appropriately 


the actual reliability (decision 




into accountability decisions. 


consistency) falls outside those 
parameters. 




State updates analysis and reporting of 
decision consistency at appropriate intervals. 


State’s evidence regarding 
accountability reliability (decision 
consistency) is not updated. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 


AYP determinations will be based primarily on assessment results from the statewide assessment 
system, NHEIAP. Annually NHEIAP goes through a complete evaluation of reliability (Standard Errors of 
Measurement, Accuracy and Consistency). The results are published in the NHEIAP Technical Manual 


(2001-2002 NHEIAP Technical Manual is available upon request). 




The NH DOE has contracted with the Center for Assessment to establish an assessment/accountability 
Technical Advisory Committee. It will be the responsibility of this group to review all the academic 
indicators for validity and reliability and to ensure the integrity of the process as we transition into annual 


assessments. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


9.4 What is the State's process 
for making valid AYP 
determinations? 


State has established a process 
for public schools and LEAs to 
appeal an accountability decision. 


State does not have a system for 
handling appeals of accountability 
decisions. 



STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



The process for making AYP determinations will be widely publicized (NH DOE website, Superintendent’s 
Key Messages monthly e-mail, New Hampshire NCLB list serve). 

A report of assessment data is sent to all schools for verification (two weeks) prior to its public release. 
Data from schools that will form the basis of our graduation rates and retention rates, data are reviewed 
and confirmed by the superintendents. AYP determinations will be made based on this information and 
reports will be sent to all schools. A school wishing to appeal its AYP designation will have 30 days to 
present an appeal to their district. A district wishing to appeal its AYP designation will have 30 days to 
present an appeal to the Commissioner of Education or his designee. Guidelines for the appeal process 
will appear on the NH DOE website and will be given to every school that has not made AYP. 

The NH DOE has established an Assessment / Accountability Policy Advisory Group It will be the 
responsibility of this group to audit the appeal process. 
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CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


9.4 How has the 
State planned for 
incorporating into 
its definition of 
AYP anticipated 
changes in 
assessments? 


State has a plan to maintain continuity in AYP 
decisions necessary for validity through planned 
assessment changes, and other changes 
necessary to comply fully with NCLB. 1 

State has a plan for including new public schools in 
the State Accountability System. 

State has a plan for periodically reviewing its State 
Accountability System, so that unforeseen changes 
can be quickly addressed. 


State’s transition plan 
interrupts annual 
determination of AYP. 

State does not have a plan 
for handling changes: e.g., 
to its assessment system, 
or the addition of new 
public schools. 


STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 


The NH DOE has contracted with the Center for Assessment to form a Technical Advisory Committee. It 
will be the responsibility of this group to develop policy for anticipated changes to AYP as we move to 
annual assessments and add new public schools. 



21 Several events may occur which necessitate such a plan. For example, (1) the State may need to 
include additional assessments in grades 3-8 by 2005-2006; (2) the State may revise content and/or 
academic achievement standards; (3) the State may need to recalculate the starting point with the 
addition of new assessments; or (4) the State may need to incorporate the graduation rate or other 
indicators into its State Accountability System. These events may require new calculations of validity and 
reliability. 
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PRINCIPLE 10. In order for a public school or LEA to make AYP, the State 
ensures that it assessed at least 95% of the students enrolled in each subgroup. 



CRITICAL ELEMENT 


EXAMPLES FOR 
MEETING REQUIREMENTS 


EXAMPLES OF 
NOT MEETING 
REQUIREMENTS 


10.2 What is the State's method 
for calculating participation 
rates in the State 
assessments for use in 
AYP determinations? 


State has a procedure to 
determine the number of absent 
or untested students (by 
subgroup and aggregate). 

State has a procedure to 
determine the denominator (total 
enrollment) for the 95% 
calculation (by subgroup and 
aggregate). 


The state does not have a 
procedure for determining the 
rate of students participating in 
statewide assessments. 

Public schools and LEAs are not 
held accountable for testing at 
least 95% of their students. 




Public schools and LEAs are held 
accountable for reaching the 95% 
assessed goal. 




STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 


New Hampshire collects student demographic data on every student enrolled on the first day of the 
statewide assessment. Participation rates for every group and subgroup at the school, district, and state 
level will be calculated based on the total enrollment on the first day of testing. Due to the large number 
of small schools and small districts in the state, a cell size for participation rate accountability will be 40. 
Subgroups that fall under the cell size at the school level may still show up at the district level and will 
show up at the state level. New Hampshire does not intend to use confidence intervals on the 95% 
participation requirement. 
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EXAMPLES FOR 


EXAMPLES OF 


CRITICAL ELEMENT 


MEETING REQUIREMENTS 


NOT MEETING 
REQUIREMENTS 


10.3 What is the State’s 


State has a policy that implements the 


State does not have a 


policy for determining 


regulation regarding the use of 95% 


procedure for making this 


when the 95% 


allowance when the group is statistically 


determination. 


assessed requirement 
should be applied? 


significant according to State rules. 





STATE RESPONSE AND STATE ACTIVITIES FOR MEETING REQUIREMENTS 



See section 10.1 
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Appendix A 

Required Data Elements for State Report Card 



1111(h)(1)(C) 

1 . Information, in the aggregate, on student achievement at each proficiency level on the State academic 
assessments (disaggregated by race, ethnicity, gender, disability status, migrant status, English 
proficiency, and status as economically disadvantaged, except that such disaggregation shall not be 
required in a case in which the number of students in a category is insufficient to yield statistically reliable 
information or the results would reveal personally identifiable information about an individual student. 

2. Information that provides a comparison between the actual achievement levels of each student 
subgroup and the State’s annual measurable objectives for each such group of students on each of the 
academic assessments. 

3. The percentage of students not tested (disaggregated by the student subgroups), except that such 
disaggregation shall not be required in a case in which the number of students in a category is insufficient 
to yield statistically reliable information or the results would reveal personally identifiable information 
about an individual student. 

4. The most recent 2-year trend in student achievement in each subject area, and for each grade level, 
for the required assessments. 

5. Aggregate information on any other indicators used by the State to determine the adequate yearly 
progress of students in achieving State academic achievement standards disaggregated by student 
subgroups. 

6. Graduation rates for secondary school students disaggregated by student subgroups. 

7. Information on the performance of local educational agencies in the State regarding making adequate 
yearly progress, including the number and names of each school identified for school improvement under 
section 1116. 

8. The professional qualifications of teachers in the State, the percentage of such teachers teaching with 
emergency or provisional credentials, and the percentage of classes in the State not taught by highly 
qualified teachers, in the aggregate and disaggregated by high-poverty compared to low-poverty schools 
which (for this purpose) means schools in the top quartile of poverty and the bottom quartile of poverty in 
the State. 
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